-- Logs begin at Fri 2021-08-27 03:09:41 UTC, end at Fri 2021-08-27 04:32:55 UTC. -- Aug 27 03:54:13.421865 dv-cinder-804757-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 03:54:13 2021] *** Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: nodename: dv-cinder-804757-2-iscsi Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: machine: x86_64 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: clock source: unix Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: pcre jit disabled Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: detected number of CPU cores: 4 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: current working directory: / Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: detected binary path: /usr/bin/uwsgi-core Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: your processes number limit is 47680 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: your memory page size is 4096 bytes Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: detected max file descriptor number: 2048 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: lock engine: pthread robust mutexes Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: thunder lock: enabled Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 03:54:13.433121 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 03:54:13.477213 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: Python main interpreter initialized at 0x55ef7b9ed9c0 Aug 27 03:54:13.477213 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: python threads support enabled Aug 27 03:54:13.477213 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: your server socket listen backlog is limited to 100 connections Aug 27 03:54:13.477213 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: your mercy for graceful operations on workers is 90 seconds Aug 27 03:54:13.477533 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 03:54:13.477622 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: *** Operational MODE: preforking *** Aug 27 03:54:13.477891 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: *** uWSGI is running in multiple interpreter mode *** Aug 27 03:54:13.477891 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: spawned uWSGI master process (pid: 93792) Aug 27 03:54:13.478083 dv-cinder-804757-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 03:54:13.479801 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: spawned uWSGI worker 1 (pid: 93793, cores: 1) Aug 27 03:54:13.479801 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: spawned uWSGI worker 2 (pid: 93794, cores: 1) Aug 27 03:54:13.479801 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 03:54:15.134449 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:54:15.134449 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: from cryptography.utils import int_from_bytes Aug 27 03:54:15.135151 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:54:15.135151 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: from cryptography.utils import int_from_bytes Aug 27 03:54:15.137825 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:54:15.137825 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: from cryptography.utils import int_from_bytes Aug 27 03:54:15.138309 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 03:54:15.138309 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: from cryptography.utils import int_from_bytes Aug 27 03:54:17.828132 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:54:17.828769 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 03:54:17.829117 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:54:17.829232 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 03:54:17.829327 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:54:17.829420 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 03:54:17.829499 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:54:17.829584 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 03:54:17.829668 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:54:17.829746 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 03:54:17.829822 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.829909 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.830131 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.830230 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.830453 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.830544 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.830789 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.830890 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.831114 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.831212 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.831420 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.831518 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.831735 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.831821 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832050 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832135 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832371 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832465 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832629 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832724 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.832938 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833030 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833256 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-2-iscsi {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833350 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-2-iscsi {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833571 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833662 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833872 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.833963 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.834176 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.834273 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.834487 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.834609 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.834812 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.834898 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.835128 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.835215 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.835427 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.835512 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.835921 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.836022 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.836348 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.836461 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.836648 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.836769 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.836953 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.837071 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.837283 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.837413 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.837591 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.837686 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.837896 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838006 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838203 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838326 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838499 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838622 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838845 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.838940 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.839151 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.839237 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.839534 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-2-iscsi {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.839623 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-2-iscsi {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.839846 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.839933 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.840161 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.840300 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.840468 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.840564 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.840871 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.840960 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.841227 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.841378 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.841472 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.841551 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.841863 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.842493 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.842749 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.842863 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.843057 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.843146 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.843380 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.843471 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.843697 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.843783 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844012 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844102 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844326 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844423 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844623 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844710 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.844929 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845027 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845233 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845319 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845548 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845635 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845846 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.845944 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.846146 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.846233 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.846391 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.846476 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.846718 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.846826 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847034 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847130 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847350 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847436 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847666 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847764 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.847918 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848042 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848167 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848266 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848478 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848567 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848793 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.848882 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.849099 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.849197 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.849404 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.849489 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.849706 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.849792 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850009 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850107 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850313 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850411 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850634 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850724 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.850939 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.851038 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.851243 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.851330 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.851556 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.851641 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.851867 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852009 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852181 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852268 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852485 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852571 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852800 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.852894 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.853190 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.853276 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.853438 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.853522 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.853739 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.853825 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.854074 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.854160 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.854386 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.854470 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.854711 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.854801 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855027 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855113 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855344 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855429 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855648 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855735 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.855951 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856036 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856253 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856337 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856565 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856653 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856881 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.856968 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.857180 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.857277 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.857951 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.858058 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.858251 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.858344 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.858554 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.858746 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.858895 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859063 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859202 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859370 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859510 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859675 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859818 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.859981 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.860119 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.860278 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.860432 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.860583 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.860723 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.860888 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861032 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861193 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861340 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861498 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861648 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861803 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.861952 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.862102 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.862260 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.862406 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.862607 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.862731 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.862888 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863032 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863206 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863344 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863523 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863658 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863831 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.863961 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.864141 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.864265 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.864446 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.864567 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.864753 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.864870 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.865077 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.865172 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.865384 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.865470 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.865690 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.865776 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.866011 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.866098 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.866316 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.866408 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.866644 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.866735 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867011 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867100 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867320 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867404 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867625 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867712 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.867938 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868025 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868252 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868388 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868538 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868630 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868849 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.868936 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.869152 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.869236 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.869450 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.869544 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.869749 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.869841 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870047 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870132 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870345 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870442 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870667 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870758 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.870969 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871056 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871267 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871365 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871562 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871647 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871872 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.871956 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.872189 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.872283 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.872493 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.872578 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.872799 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.872891 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.873673 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.873866 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.873987 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.874188 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 03:54:17.874320 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.874522 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.874656 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.874875 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.874994 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.875216 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.875303 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.875529 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.875624 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.875858 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.875947 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.876192 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.876286 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.876505 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.876600 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.876813 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.876906 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.877124 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.877211 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.877446 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.877534 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.877754 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.877839 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.878058 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.878207 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.878365 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.878504 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.878703 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.878792 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879023 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879111 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879335 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879433 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879649 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879774 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.879963 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880061 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880270 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880363 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880574 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880711 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880888 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.880983 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.881203 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.881290 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.881513 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.881605 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.881818 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.881904 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.882152 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.882240 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.882475 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.882587 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.882806 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.882894 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.883121 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.883208 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.883425 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.883510 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.883740 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.883839 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884050 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884143 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884358 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884443 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884663 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884756 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.884974 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885061 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885280 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885366 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885587 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885687 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885909 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.885995 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.886221 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.886314 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.886523 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.886643 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.886853 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.886939 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.887151 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.887243 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.887451 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.887539 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.887752 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.887838 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.888048 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.888140 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.888365 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.888458 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.888707 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.888802 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.889011 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.889294 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.889389 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.889612 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.889699 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.889917 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890002 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890222 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890384 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890524 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890660 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890856 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.890945 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.891162 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.891258 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.891463 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.891558 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.891779 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.891872 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.892084 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.892172 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.892388 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.892473 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.892708 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.892795 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893010 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893102 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893311 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893404 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893621 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893714 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.893924 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894011 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894231 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894323 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894540 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894644 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894883 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.894977 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.895193 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.895279 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.895502 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.895599 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.895835 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.895928 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.896160 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.896247 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.896460 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.896556 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.896780 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.896872 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.897099 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.897184 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.897412 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.897506 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.897712 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.897798 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898018 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898103 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898320 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898413 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898644 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898745 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.898946 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899038 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899249 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899346 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899548 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899642 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899848 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.899940 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.900148 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.900235 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.900446 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.900531 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.900744 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.900872 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901056 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901144 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901359 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901444 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901659 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901751 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.901957 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.902044 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.902257 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.902349 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.902611 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.902699 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.902914 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903008 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903248 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903335 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903576 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903669 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903889 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.903974 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.904222 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.904309 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.904585 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.904719 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.905086 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.905176 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.905402 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.905489 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.905716 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.905822 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906031 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906116 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906341 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906427 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906691 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906800 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.906999 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.907085 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.907318 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.907404 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.907625 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.907719 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.907947 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908032 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908254 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908339 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908574 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908668 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908875 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.908964 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.909187 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.909277 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.909522 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.909610 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.909850 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.909942 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.910166 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.910258 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.910483 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.910595 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.910817 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.910903 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.911130 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.911213 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.911436 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.911520 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.911744 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.911829 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912051 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912137 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912361 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912447 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912677 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912768 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.912987 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.913082 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.913304 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.913389 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.913609 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.913694 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.913925 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914026 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914231 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914316 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914547 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914655 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914876 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.914978 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.915184 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.915269 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.915505 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.915591 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.915835 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.915929 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.916138 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.916223 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.916448 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.916534 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.916765 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.916860 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917073 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917159 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917378 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917464 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917684 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917771 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.917984 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.918070 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.918285 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.918372 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.918610 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.918711 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.918926 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.919011 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.919231 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.919330 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.919537 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.919627 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.919839 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.920522 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.920673 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.920814 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.921231 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.921534 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.921621 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.921835 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.921922 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.922146 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.922245 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.922462 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.922588 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.922793 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.922879 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.923109 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.923204 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.923424 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.923511 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.923724 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.923811 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924022 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924116 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924324 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924416 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924631 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924716 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.924932 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925019 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925232 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925356 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925534 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925620 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925838 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.925927 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.926175 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.926260 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.926476 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.926591 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.926820 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.926936 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.927134 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.927234 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.927436 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.927530 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.927748 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.927834 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928055 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928142 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928361 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928458 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928668 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928753 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.928975 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929061 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929279 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929374 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929585 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929670 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929890 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.929975 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.930199 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.930293 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.930506 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.930619 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.930846 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.930931 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.931149 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.931235 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.931458 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.931544 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.931764 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.931856 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932067 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932174 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932364 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932450 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932675 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932759 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.932990 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.933243 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.933557 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.933645 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.933874 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.933965 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.934188 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.934275 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.934502 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.934606 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.934841 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.934940 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.935161 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.935254 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.936136 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.936305 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.936394 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.936628 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.936742 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.936936 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.937077 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.937240 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.937389 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.937540 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.937704 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.937846 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938012 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938148 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938319 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938451 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938657 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938774 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.938968 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939081 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939276 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939364 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939581 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939667 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939893 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.939979 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.940200 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.940287 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.940507 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.940602 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.940822 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.940908 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.941128 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.941229 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.941428 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.941532 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.941732 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.941818 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942039 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942136 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942337 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942438 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942656 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942761 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.942960 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943054 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943275 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943369 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943581 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943668 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943888 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.943974 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.944225 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.944311 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.944531 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.944623 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.944853 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.944938 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.945155 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.945245 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.945483 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.945617 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.945788 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.945874 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.946091 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.946178 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.946392 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.946485 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.946721 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.946812 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947030 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947116 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947328 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947413 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947635 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947729 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.947944 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948029 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948246 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948331 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948548 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948645 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948852 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.948938 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.949157 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.949243 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.949455 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.949550 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.949759 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.949844 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950065 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950150 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950365 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950461 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950686 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950777 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.950995 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.951091 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.951432 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.951509 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.951631 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.951707 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.951941 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952029 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952248 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952336 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952552 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952638 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952861 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.952954 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.953167 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.953255 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.953466 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.953551 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.953771 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.953856 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.954077 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.954163 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.954379 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.954473 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.954713 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.954801 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955022 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955115 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955327 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955412 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955630 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955724 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.955931 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956034 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956234 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956335 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956538 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956634 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956842 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.956935 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.957153 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.957246 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.957450 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.957543 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.957756 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.957843 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958059 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958145 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958361 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958459 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958683 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958773 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.958989 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959086 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959292 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959391 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959595 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959681 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959896 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.959982 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.960197 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.960284 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.960498 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.960584 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.960799 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.960885 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.961102 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.961189 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.961403 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.961487 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.961705 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.961792 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962007 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962094 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962311 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962396 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962641 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962747 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.962951 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.963045 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.963297 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.963383 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.963606 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.963693 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.963921 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964007 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964235 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964320 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964547 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964641 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964857 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.964943 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.965166 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.965251 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.965477 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.965574 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.965788 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.965874 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.966094 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.966180 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.966393 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.966491 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.966717 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.966824 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.967135 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.967255 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.967519 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.967618 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.967838 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.967924 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.968165 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.968260 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.968482 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.968577 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.968798 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.968884 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.969099 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.969183 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.969410 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.969497 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.969723 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.969809 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970032 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970125 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970343 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970431 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970682 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970772 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.970995 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.971123 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.971307 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.971447 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.971617 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.971730 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.971945 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972067 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972239 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972359 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972546 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972658 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972854 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.972982 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.973162 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.973274 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.973464 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.973579 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.973773 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.973963 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974079 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974190 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974369 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974489 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974695 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974828 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.974989 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.975102 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.975303 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.975447 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.975605 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.975729 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976340 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976427 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976508 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976585 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976671 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976751 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.976931 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977018 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977242 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977355 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977554 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977649 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977864 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.977949 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.978175 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.978269 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.978477 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.978637 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.978821 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.978908 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.979142 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.979241 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.979451 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.979604 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.979809 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.979898 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.980111 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.980211 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.980412 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.980505 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.980722 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.980810 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981042 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981137 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981344 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981455 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981647 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981733 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.981949 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.982093 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.982264 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.982350 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.983111 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.983201 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.983435 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.983713 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.983849 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.984046 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.984142 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.984361 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.984457 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.984695 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.984845 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.985124 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.985211 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.985440 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.985528 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.985750 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.985835 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.986070 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.986162 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.986390 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.986478 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.986717 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.986807 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987029 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987117 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987336 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987425 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987656 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987743 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.987976 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988065 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988285 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988374 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988597 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988694 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988898 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.988985 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.989218 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.989307 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.989539 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.989671 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.989852 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.989948 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.990162 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.990247 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.990492 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.990615 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.990850 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.990949 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.991168 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.991255 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.991495 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.991581 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.991817 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.991928 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.992122 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.992264 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.992440 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.992565 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.992731 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.992845 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993037 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993161 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993341 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993455 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993661 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993774 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.993966 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.994087 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.994274 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.994387 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.994602 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.994731 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.994917 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995040 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995217 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995330 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995520 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995640 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995839 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.995953 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.996142 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.996254 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.996452 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.996564 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.996761 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.996876 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.997076 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.997188 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.997381 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.997507 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.997683 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.997771 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.998028 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.998121 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.998892 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.998982 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.999198 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.999287 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.999502 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.999589 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.999808 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:17.999895 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.000120 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.000208 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.000428 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.000516 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.000736 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.000831 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001044 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001131 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001370 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001457 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001677 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001772 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.001995 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.002081 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.002319 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.002406 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.002656 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.002769 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.002973 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003063 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003294 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003389 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003592 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003688 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003892 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.003983 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.004236 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.004336 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.004494 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.004584 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.004799 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.004886 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005098 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005186 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005400 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005489 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005697 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005785 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.005996 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.006083 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.006299 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.006388 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.006631 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.006748 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.006942 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007042 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007248 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007343 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007555 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007644 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007857 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.007952 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.008162 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.008255 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.008480 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.008573 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.008789 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.008885 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.009095 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.009189 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.009403 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.009490 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.009707 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.009802 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010033 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010125 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010339 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010431 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010677 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010782 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.010999 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.011087 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.011317 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.011407 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.011632 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.011727 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.011945 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012038 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012257 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012344 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012572 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012660 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012886 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.012971 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.013196 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.013281 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.013504 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.013592 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.013843 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.013938 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.014159 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.014243 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.014473 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.014593 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.014869 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015048 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015189 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015377 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015508 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015689 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015825 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.015998 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.016309 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.016403 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.016623 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.016717 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.016935 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017028 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017244 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017339 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017551 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017684 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017857 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.017944 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.018166 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.018262 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.018490 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.018595 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.018832 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.018919 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.019150 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.019238 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.019462 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.019549 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.019776 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.019861 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.020090 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.020178 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.020404 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.020494 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.020718 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.020806 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021039 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021125 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021359 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021446 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021659 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021817 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.021970 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.022057 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.022279 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.022365 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.022607 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.022715 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.022918 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023005 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023225 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023311 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023534 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023623 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023843 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.023932 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.024148 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.024234 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.024453 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.024541 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.024769 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.024857 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.025079 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.025165 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.025387 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.025474 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.025699 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.025793 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026013 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026108 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026321 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026407 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026656 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026746 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.026977 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.027099 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.027308 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.027486 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.027622 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.027796 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.027940 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.028126 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.028257 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.028447 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.028765 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.028852 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.029080 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.029317 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.029531 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.029608 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.029947 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.030072 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.030346 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.030497 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.030695 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.031019 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.031105 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.031352 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.031552 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.031756 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.031875 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.032069 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.032187 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.032403 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.032499 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.032814 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.032937 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.033124 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.033444 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.033529 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.033753 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.034032 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.034285 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.034409 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.034669 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.034910 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.035001 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.035298 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.035495 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.035621 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.035936 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.036056 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.036241 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.036563 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.036867 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.036997 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.037169 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.037372 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.037482 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.037708 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.037835 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.038052 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.038144 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.038365 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.038604 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.038821 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.039132 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.039218 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.039434 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.039680 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.039767 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040030 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040115 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040353 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040448 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040653 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040738 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.040957 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.041043 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.041259 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.041353 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.041567 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.041671 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.041897 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.042216 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.042531 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.042683 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.042867 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043009 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043186 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043327 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043498 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043644 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043833 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.043961 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.044145 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.044273 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.044461 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.044587 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.044770 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.045809 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.047132 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.047237 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.047493 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.047583 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.047823 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.047912 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.048156 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.048253 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.048478 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.048567 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.048798 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.048884 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.049122 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.049209 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.049431 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.049527 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.049763 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.049859 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.050080 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.050168 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.050409 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.050509 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.050749 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.050837 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.051070 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.051170 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.051403 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.051489 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.051716 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.051810 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.052044 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.052274 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.052363 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.052614 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.052701 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.052956 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.053043 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.053287 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.053380 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.053631 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.053716 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.053941 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.054029 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.054251 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.054498 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.054626 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.054865 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.054954 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.055192 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.055286 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.055505 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.055594 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.055816 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.055911 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.056130 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.056225 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.056443 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.056530 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.056755 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.056849 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.057069 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.057204 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.057389 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.057478 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.057707 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.057795 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058016 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058138 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058326 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058415 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058662 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058767 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.058982 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.059076 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.059298 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.059385 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.059613 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.059710 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.059928 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.060022 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.060234 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.060320 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.061095 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.061204 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.061453 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.061533 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.061831 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.062007 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.062154 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.062340 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.062486 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.062690 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.062828 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063022 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063132 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063341 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063552 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063648 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063869 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.063958 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.064189 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.064280 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.064512 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.064599 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.064823 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.064910 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.065145 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.065234 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.065468 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.065563 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.065785 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.065912 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.066102 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.066236 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.066413 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.066586 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.066771 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.066910 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.067115 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.067228 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.067441 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.067553 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.067765 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.067863 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068072 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068185 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068376 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068511 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068680 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068827 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.068989 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.069158 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.069320 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.069502 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.069633 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.069832 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.069955 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.070160 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.070249 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.070470 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.070584 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.070811 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.070917 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.071116 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.071216 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.071431 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.071529 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.071768 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.071868 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.072086 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.072175 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.072410 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.072497 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.072718 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.072805 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073032 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073120 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073341 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073429 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073645 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073731 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.073952 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.074039 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.074260 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.074349 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.074602 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.074692 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.074942 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075040 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075247 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075335 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075564 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075650 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075877 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.075971 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.076232 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.076337 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.076535 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.076638 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.076844 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.076942 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.077174 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.077269 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.077484 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.077594 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.077800 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.077896 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.078110 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.078248 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.078419 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.078511 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.078759 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.078851 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.079072 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.079159 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.079394 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.079483 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.079716 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.079814 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.080035 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.080123 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.080353 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.080441 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.080695 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.080782 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081007 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081092 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081324 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081417 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081643 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081730 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.081884 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:54:18.081971 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.082288 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.082639 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.082970 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.083319 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.083639 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.083988 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.084320 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 03:54:18.084566 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 03:54:18.104867 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_db.sqlalchemy.engines [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.107184 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_db.sqlalchemy.engines [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.184120 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.context [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b77e019-e5d4-4508-b689-805a75164f6e(cell1) {{(pid=93793) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:54:18.184663 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.context [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b77e019-e5d4-4508-b689-805a75164f6e(cell1) {{(pid=93794) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 03:54:18.189007 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_concurrency.lockutils [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:18.189344 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:18.190634 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_concurrency.lockutils [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:18.190966 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:18.191431 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_concurrency.lockutils [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:18.191773 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 03:54:18.193422 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_concurrency.lockutils [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:18.193703 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 03:54:18.205978 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_db.sqlalchemy.engines [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.208502 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_db.sqlalchemy.engines [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.211716 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_db.sqlalchemy.engines [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.212575 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_db.sqlalchemy.engines [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.564481 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG oslo_db.sqlalchemy.engines [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:18.570385 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_db.sqlalchemy.engines [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 03:54:19.032533 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: WARNING keystonemiddleware.auth_token [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:54:19.039232 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: WARNING keystonemiddleware.auth_token [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:54:19.054993 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: WARNING keystonemiddleware.auth_token [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:54:19.062590 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: WARNING keystonemiddleware.auth_token [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:54:19.393699 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: WARNING keystonemiddleware.auth_token [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:54:19.398836 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: WARNING keystonemiddleware.auth_token [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:54:19.404233 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef7b9ed9c0 pid: 93793 (default app) Aug 27 03:54:19.406956 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:54:19.408153 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] 10.222.0.73 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Aug 27 03:54:19.408580 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 789 bytes} [Fri Aug 27 03:54:19 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:54:19.411972 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: WARNING keystonemiddleware.auth_token [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 03:54:19.417345 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: WARNING keystonemiddleware.auth_token [None req-aae57f93-4532-4f85-8dc7-a4b6c216663c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 03:54:19.423966 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef7b9ed9c0 pid: 93794 (default app) Aug 27 03:55:47.738222 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:47.739389 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 27 03:55:47.740070 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 2/2] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:55:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:48.245770 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-d17af8a4-6585-445d-a734-592d1cd58706 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:48.277194 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-d17af8a4-6585-445d-a734-592d1cd58706 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.524301 Aug 27 03:55:48.277896 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Aug 27 03:55:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:50.580360 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:50.580964 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-e035b920-de59-4d3e-bbe9-b69bfb3c9049 None None] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 27 03:55:50.581862 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 3/4] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:55:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:50.647497 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-9826d6c1-aed4-48b0-97e4-2428dbb520ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:50.665835 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:55:50.665835 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: warnings.warn(msg) Aug 27 03:55:50.765757 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-9826d6c1-aed4-48b0-97e4-2428dbb520ae admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.175394 Aug 27 03:55:50.766751 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 2/5] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:55:50 2021] POST /compute/v2.1/flavors => generated 407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:55:50.992779 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-9265e2dd-90e1-49e9-b150-e12ed0a7c3e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:50.996790 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:55:50.996790 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: warnings.warn(msg) Aug 27 03:55:51.097287 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-9265e2dd-90e1-49e9-b150-e12ed0a7c3e1 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.321730 Aug 27 03:55:51.098126 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 4/6] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Aug 27 03:55:50 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:55:53.348515 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-9826d6c1-aed4-48b0-97e4-2428dbb520ae admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:53.349545 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-9826d6c1-aed4-48b0-97e4-2428dbb520ae admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001646 Aug 27 03:55:53.350255 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 3/7] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:55:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:53.458674 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-ced28820-ddaf-4eff-9dc8-4f4f678ad739 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:53.476547 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:55:53.476547 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: warnings.warn(msg) Aug 27 03:55:53.560928 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-ced28820-ddaf-4eff-9dc8-4f4f678ad739 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.202740 Aug 27 03:55:53.561507 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 5/8] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:55:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:55:53.574425 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-fbb7cda6-529f-4f40-99e5-819eae29ad49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:53.575939 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 03:55:53.575939 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: warnings.warn(msg) Aug 27 03:55:53.699104 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-fbb7cda6-529f-4f40-99e5-819eae29ad49 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128859 Aug 27 03:55:53.699881 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 4/9] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Aug 27 03:55:53 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:55:56.053792 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-ced28820-ddaf-4eff-9dc8-4f4f678ad739 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:56.054852 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-ced28820-ddaf-4eff-9dc8-4f4f678ad739 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 27 03:55:56.055258 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 6/10] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:55:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:56.124142 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-d9f14e2d-43b2-456f-8be1-3b56401979c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:56.257141 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-d9f14e2d-43b2-456f-8be1-3b56401979c4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.194085 Aug 27 03:55:56.257603 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 5/11] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:55:56 2021] POST /compute/v2.1/flavors => generated 404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:55:56.270443 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-a36719bb-5fae-4b93-96f4-fe9f38365198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:56.381191 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-a36719bb-5fae-4b93-96f4-fe9f38365198 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114444 Aug 27 03:55:56.382090 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 7/12] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Aug 27 03:55:56 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:55:58.645487 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-d9f14e2d-43b2-456f-8be1-3b56401979c4 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:55:58.646626 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-d9f14e2d-43b2-456f-8be1-3b56401979c4 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Aug 27 03:55:58.647079 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 6/13] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:55:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:55:58.722756 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-2597e23a-429e-4166-88b9-8af4b93f2472 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:58.794839 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-2597e23a-429e-4166-88b9-8af4b93f2472 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140451 Aug 27 03:55:58.795385 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 8/14] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:55:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:55:58.808076 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-0531dd28-110d-4511-bf1c-02ec48d8ebae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:55:58.906549 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-0531dd28-110d-4511-bf1c-02ec48d8ebae admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102350 Aug 27 03:55:58.907154 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 7/15] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Aug 27 03:55:58 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:01.139558 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-2597e23a-429e-4166-88b9-8af4b93f2472 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:01.140569 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-2597e23a-429e-4166-88b9-8af4b93f2472 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 27 03:56:01.140970 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 9/16] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:01.202595 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-f0887a28-90d9-48ed-b207-075639d966cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "swap": 0}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:01.320140 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-f0887a28-90d9-48ed-b207-075639d966cf admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172633 Aug 27 03:56:01.320841 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 8/17] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:56:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:56:01.334518 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-0d8452d5-fad8-438b-9a5d-f8eaa3567546 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:01.445545 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-0d8452d5-fad8-438b-9a5d-f8eaa3567546 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114743 Aug 27 03:56:01.446425 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 10/18] 10.222.0.73 () {64 vars in 1336 bytes} [Fri Aug 27 03:56:01 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:03.692734 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-f0887a28-90d9-48ed-b207-075639d966cf admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:03.693755 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-f0887a28-90d9-48ed-b207-075639d966cf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 27 03:56:03.694496 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 9/19] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:03.757521 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-7bfaea37-7eb9-4155-b48e-5088957d02bb admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:03.782708 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-7bfaea37-7eb9-4155-b48e-5088957d02bb admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080420 Aug 27 03:56:03.783252 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 11/20] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Aug 27 03:56:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:56:05.985336 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-f0887a28-90d9-48ed-b207-075639d966cf admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:05.986480 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-f0887a28-90d9-48ed-b207-075639d966cf admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001842 Aug 27 03:56:05.987033 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 10/21] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:06.054666 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-88c31b79-6d0b-4f7c-a2f4-bf8db6b0750d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "vcpus": 1, "name": "m1.tiny", "disk": 1, "id": "1"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:06.161459 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-88c31b79-6d0b-4f7c-a2f4-bf8db6b0750d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.167584 Aug 27 03:56:06.161997 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 12/22] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:56:05 2021] POST /compute/v2.1/flavors => generated 402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:06.175745 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-07197011-5973-4a2e-8b1e-aa26cc3832d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:06.262919 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-07197011-5973-4a2e-8b1e-aa26cc3832d4 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090567 Aug 27 03:56:06.263582 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 11/23] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Aug 27 03:56:06 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:08.473164 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-88c31b79-6d0b-4f7c-a2f4-bf8db6b0750d admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:08.474374 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-88c31b79-6d0b-4f7c-a2f4-bf8db6b0750d admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Aug 27 03:56:08.474806 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 13/24] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:08.537787 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-7bef1ff7-bdd9-401d-b098-57b0d6c97259 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2"}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:08.628801 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-7bef1ff7-bdd9-401d-b098-57b0d6c97259 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.145829 Aug 27 03:56:08.629355 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 12/25] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:56:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:08.642935 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-9d1c330e-ffb1-45ff-80d9-af5e9a599135 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:08.740226 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-9d1c330e-ffb1-45ff-80d9-af5e9a599135 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101121 Aug 27 03:56:08.741237 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 14/26] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Aug 27 03:56:08 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:11.094138 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-7bef1ff7-bdd9-401d-b098-57b0d6c97259 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:11.095628 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-7bef1ff7-bdd9-401d-b098-57b0d6c97259 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Aug 27 03:56:11.095743 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:11.160625 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-035fa22e-03a1-4a8a-b08d-ca78986e247e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 40, "id": "3", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:11.270036 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-035fa22e-03a1-4a8a-b08d-ca78986e247e admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.167090 Aug 27 03:56:11.270669 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 15/28] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:56:11 2021] POST /compute/v2.1/flavors => generated 406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:11.283801 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-163d5ca8-3f10-40ec-afca-e8e9d725cfe7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:11.363124 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-163d5ca8-3f10-40ec-afca-e8e9d725cfe7 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083057 Aug 27 03:56:11.363723 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 14/29] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Aug 27 03:56:11 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:13.666204 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-035fa22e-03a1-4a8a-b08d-ca78986e247e admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:13.667334 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-035fa22e-03a1-4a8a-b08d-ca78986e247e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001679 Aug 27 03:56:13.667743 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:13.732439 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-a2875146-76f1-49f4-a410-d75d3665d182 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "swap": 0, "name": "m1.large", "vcpus": 4}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:13.840461 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-a2875146-76f1-49f4-a410-d75d3665d182 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.165412 Aug 27 03:56:13.841346 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 15/31] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:56:13 2021] POST /compute/v2.1/flavors => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:13.869111 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-2896c040-d96a-4a12-906f-652f79d48bf6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:13.961721 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-2896c040-d96a-4a12-906f-652f79d48bf6 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098624 Aug 27 03:56:13.962533 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 17/32] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Aug 27 03:56:13 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:56:16.270625 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-a2875146-76f1-49f4-a410-d75d3665d182 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:16.271668 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-a2875146-76f1-49f4-a410-d75d3665d182 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Aug 27 03:56:16.272061 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 16/33] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:16.336124 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-7ed38ba5-f8f1-4868-89d0-375e8080f866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:16.457412 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-7ed38ba5-f8f1-4868-89d0-375e8080f866 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.176902 Aug 27 03:56:16.457882 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 18/34] 10.222.0.73 () {64 vars in 1283 bytes} [Fri Aug 27 03:56:16 2021] POST /compute/v2.1/flavors => generated 408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:56:16.471047 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-887c6ce8-196f-4556-8728-087344a53081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:56:16.604203 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-887c6ce8-196f-4556-8728-087344a53081 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.136146 Aug 27 03:56:16.604780 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 17/35] 10.222.0.73 () {64 vars in 1333 bytes} [Fri Aug 27 03:56:16 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:56:57.305059 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-7ed38ba5-f8f1-4868-89d0-375e8080f866 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:57.306166 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-7ed38ba5-f8f1-4868-89d0-375e8080f866 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001819 Aug 27 03:56:57.306594 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 19/36] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:56:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:56:57.365856 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-5236ed7e-7f8c-4206-88fa-5fd3daba2f5b admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:57.383850 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-5236ed7e-7f8c-4206-88fa-5fd3daba2f5b admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070762 Aug 27 03:56:57.384392 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 18/37] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Aug 27 03:56:57 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:56:58.832027 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-7ed38ba5-f8f1-4868-89d0-375e8080f866 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:58.833030 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-7ed38ba5-f8f1-4868-89d0-375e8080f866 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 27 03:56:58.833430 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 20/38] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:56:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 03:56:59.029806 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-d3d99523-9d7b-4dbc-9f86-45f748916869 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:59.035562 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.wsgi [None req-d3d99523-9d7b-4dbc-9f86-45f748916869 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 03:56:59.035804 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-d3d99523-9d7b-4dbc-9f86-45f748916869 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:56:59.036597 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-d3d99523-9d7b-4dbc-9f86-45f748916869 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058240 Aug 27 03:56:59.037103 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 19/39] 10.222.0.73 () {60 vars in 1191 bytes} [Fri Aug 27 03:56:58 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:56:59.048006 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-45dd79ef-8571-4fb8-8b72-ad331e936255 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:59.068933 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-45dd79ef-8571-4fb8-8b72-ad331e936255 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024731 Aug 27 03:56:59.069518 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 21/40] 10.222.0.73 () {60 vars in 1211 bytes} [Fri Aug 27 03:56:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:56:59.080596 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-44eed274-3875-42bd-8041-118b97caca75 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:59.107291 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-44eed274-3875-42bd-8041-118b97caca75 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.030317 Aug 27 03:56:59.107866 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 20/41] 10.222.0.73 () {60 vars in 1211 bytes} [Fri Aug 27 03:56:59 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:56:59.117999 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-f60a72b5-c970-467a-832a-2197406ff5dc admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:56:59.123491 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.wsgi [None req-f60a72b5-c970-467a-832a-2197406ff5dc admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 27 03:56:59.124059 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-f60a72b5-c970-467a-832a-2197406ff5dc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:56:59.124842 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-f60a72b5-c970-467a-832a-2197406ff5dc admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010563 Aug 27 03:56:59.125336 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 22/42] 10.222.0.73 () {60 vars in 1191 bytes} [Fri Aug 27 03:56:59 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:00.484192 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-44eed274-3875-42bd-8041-118b97caca75 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:00.485182 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-44eed274-3875-42bd-8041-118b97caca75 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 Aug 27 03:57:00.485563 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 21/43] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:00.677444 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-c52269b6-0ca7-40f6-bc61-4707e5e2f313 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:00.684665 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.wsgi [None req-c52269b6-0ca7-40f6-bc61-4707e5e2f313 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 03:57:00.685229 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-c52269b6-0ca7-40f6-bc61-4707e5e2f313 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:57:00.686022 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-c52269b6-0ca7-40f6-bc61-4707e5e2f313 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.061056 Aug 27 03:57:00.686522 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 23/44] 10.222.0.73 () {60 vars in 1191 bytes} [Fri Aug 27 03:57:00 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:00.697217 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-6f1981d3-1b94-4154-8878-58a96c805635 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:00.710383 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-6f1981d3-1b94-4154-8878-58a96c805635 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017789 Aug 27 03:57:00.712156 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 22/45] 10.222.0.73 () {60 vars in 1211 bytes} [Fri Aug 27 03:57:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:57:00.722540 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-cc6dc0bc-480b-486b-9691-69c44ce5a17e admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:00.736281 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-cc6dc0bc-480b-486b-9691-69c44ce5a17e admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017140 Aug 27 03:57:00.736798 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 24/46] 10.222.0.73 () {60 vars in 1211 bytes} [Fri Aug 27 03:57:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:57:00.746697 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-8f470ef0-9f8c-4a79-a996-debc1f73a05a admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:00.751800 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.wsgi [None req-8f470ef0-9f8c-4a79-a996-debc1f73a05a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 27 03:57:00.752353 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-8f470ef0-9f8c-4a79-a996-debc1f73a05a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:57:00.753135 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-8f470ef0-9f8c-4a79-a996-debc1f73a05a admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.009948 Aug 27 03:57:00.753614 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 23/47] 10.222.0.73 () {60 vars in 1191 bytes} [Fri Aug 27 03:57:00 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:02.114910 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-cc6dc0bc-480b-486b-9691-69c44ce5a17e admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:02.115918 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-cc6dc0bc-480b-486b-9691-69c44ce5a17e admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 27 03:57:02.116318 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 25/48] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:02.307975 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-ed078d66-db96-4d14-a2fb-07c66d3a1424 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:02.313604 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.wsgi [None req-ed078d66-db96-4d14-a2fb-07c66d3a1424 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 03:57:02.314157 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-ed078d66-db96-4d14-a2fb-07c66d3a1424 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:57:02.314974 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-ed078d66-db96-4d14-a2fb-07c66d3a1424 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.058341 Aug 27 03:57:02.315465 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 24/49] 10.222.0.73 () {60 vars in 1194 bytes} [Fri Aug 27 03:57:02 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:02.325389 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-86ad1cb5-dce2-46cb-bd03-238779cc8bd6 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:02.339154 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-86ad1cb5-dce2-46cb-bd03-238779cc8bd6 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017471 Aug 27 03:57:02.339675 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 26/50] 10.222.0.73 () {60 vars in 1211 bytes} [Fri Aug 27 03:57:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:57:02.349321 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:02.363374 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017442 Aug 27 03:57:02.363888 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 25/51] 10.222.0.73 () {60 vars in 1211 bytes} [Fri Aug 27 03:57:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 03:57:02.374018 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-04e81117-32db-41a9-a63f-db01c67ea7b4 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:02.379277 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.wsgi [None req-04e81117-32db-41a9-a63f-db01c67ea7b4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 27 03:57:02.379833 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-04e81117-32db-41a9-a63f-db01c67ea7b4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 03:57:02.380612 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-04e81117-32db-41a9-a63f-db01c67ea7b4 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010205 Aug 27 03:57:02.381094 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 27/52] 10.222.0.73 () {60 vars in 1194 bytes} [Fri Aug 27 03:57:02 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 27 03:57:03.727768 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:03.728755 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 27 03:57:03.729143 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 26/53] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:03.923025 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-3b903ebd-e3c2-4f8e-bdd2-25d44c199234 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:03.991900 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-3b903ebd-e3c2-4f8e-bdd2-25d44c199234 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.120379 Aug 27 03:57:03.992462 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 28/54] 10.222.0.73 () {64 vars in 1236 bytes} [Fri Aug 27 03:57:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:57:05.338363 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:05.339388 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 27 03:57:05.339780 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:05.528570 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-76b684e8-7ff2-4f50-9a09-8503b0664a9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:05.609305 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-76b684e8-7ff2-4f50-9a09-8503b0664a9d admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.133075 Aug 27 03:57:05.609779 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 29/56] 10.222.0.73 () {64 vars in 1236 bytes} [Fri Aug 27 03:57:05 2021] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:57:06.977632 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:06.978668 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 27 03:57:06.979064 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 28/57] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:06 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:07.171150 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-61bbe1fa-6266-46e1-b156-c3d3aaf3c784 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:07.319245 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-61bbe1fa-6266-46e1-b156-c3d3aaf3c784 admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.199714 Aug 27 03:57:07.319799 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 30/58] 10.222.0.73 () {64 vars in 1236 bytes} [Fri Aug 27 03:57:07 2021] POST /compute/v2.1/flavors => generated 407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 03:57:08.674824 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:08.678692 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 27 03:57:08.678692 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 29/59] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:08.876629 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-609103ef-60c3-4694-9086-cf389b362eca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 03:57:08.946240 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-609103ef-60c3-4694-9086-cf389b362eca admin admin] 10.222.0.73 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.122460 Aug 27 03:57:08.946828 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 31/60] 10.222.0.73 () {64 vars in 1236 bytes} [Fri Aug 27 03:57:08 2021] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 03:57:10.287740 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:10.288786 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 27 03:57:10.289176 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 30/61] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 03:57:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:10.485110 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-4c3e39bb-416f-45f6-b0ea-0811484fa1da admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:10.503911 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-4c3e39bb-416f-45f6-b0ea-0811484fa1da admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.072196 Aug 27 03:57:10.504374 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 32/62] 10.222.0.73 () {60 vars in 1203 bytes} [Fri Aug 27 03:57:10 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:57:55.825034 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:55.826395 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-4c186f15-edea-49d3-97bd-0e42ca84dfb1 admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Aug 27 03:57:55.827061 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 31/63] 10.222.0.73 () {54 vars in 931 bytes} [Fri Aug 27 03:57:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 03:57:55.908617 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-22be5ea1-b6fc-4276-a8a5-08661e5ab2a2 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:55.931672 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-22be5ea1-b6fc-4276-a8a5-08661e5ab2a2 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.093250 Aug 27 03:57:55.932421 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 33/64] 10.222.0.73 () {60 vars in 1292 bytes} [Fri Aug 27 03:57:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 03:57:55.957630 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-8334a24f-6a12-4f16-a8d3-12bf3f8f6f27 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:55.968842 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-8334a24f-6a12-4f16-a8d3-12bf3f8f6f27 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016220 Aug 27 03:57:55.969531 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 32/65] 10.222.0.73 () {60 vars in 1283 bytes} [Fri Aug 27 03:57:55 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:55.987685 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-1b92667d-cb67-49d3-b0bf-e9c709128080 admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:56.002976 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-1b92667d-cb67-49d3-b0bf-e9c709128080 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019750 Aug 27 03:57:56.003806 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 34/66] 10.222.0.73 () {60 vars in 1286 bytes} [Fri Aug 27 03:57:55 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:57:56.020055 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-ff61dfe2-52db-46b0-8193-6850949e5381 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:56.028945 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-ff61dfe2-52db-46b0-8193-6850949e5381 admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012513 Aug 27 03:57:56.029542 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 33/67] 10.222.0.73 () {60 vars in 1286 bytes} [Fri Aug 27 03:57:56 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 03:57:56.045238 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:57:56.054947 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] 10.222.0.73 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015548 Aug 27 03:57:56.055681 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 35/68] 10.222.0.73 () {60 vars in 1283 bytes} [Fri Aug 27 03:57:56 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 03:59:39.797495 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-80b6225a-5494-4f21-a756-cfcda20bbc91 tempest-verify_tempest_config-884549739 tempest-verify_tempest_config-884549739-project] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 03:59:39.799522 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-80b6225a-5494-4f21-a756-cfcda20bbc91 tempest-verify_tempest_config-884549739 tempest-verify_tempest_config-884549739-project] 10.222.0.73 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121374 Aug 27 03:59:39.800057 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 34/69] 10.222.0.73 () {58 vars in 1134 bytes} [Fri Aug 27 03:59:39 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:01:16.766012 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:16.767780 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002532 Aug 27 04:01:16.768498 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 36/70] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 04:01:16 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:17.099296 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-6b924e2b-9cd9-4d92-b058-fae0714d0778 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:17.100476 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:01:17.100476 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: warnings.warn(msg) Aug 27 04:01:17.102087 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-6b924e2b-9cd9-4d92-b058-fae0714d0778 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:17.102524 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-6b924e2b-9cd9-4d92-b058-fae0714d0778 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:17.103404 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-6b924e2b-9cd9-4d92-b058-fae0714d0778 admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:17.103822 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-6b924e2b-9cd9-4d92-b058-fae0714d0778 admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:17.142994 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-6b924e2b-9cd9-4d92-b058-fae0714d0778 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.223594 Aug 27 04:01:17.143572 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 35/71] 10.222.0.73 () {60 vars in 1194 bytes} [Fri Aug 27 04:01:16 2021] GET /compute/v2.1/os-services => generated 791 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:01:18.641184 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:18.642937 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002421 Aug 27 04:01:18.643630 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 37/72] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 04:01:18 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:18.866845 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-2672702f-76e0-4caa-a96b-a58ffca4c553 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:18.868038 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:01:18.868038 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: warnings.warn(msg) Aug 27 04:01:18.869577 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-2672702f-76e0-4caa-a96b-a58ffca4c553 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:18.870041 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-2672702f-76e0-4caa-a96b-a58ffca4c553 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:18.871676 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-2672702f-76e0-4caa-a96b-a58ffca4c553 admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:18.872100 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-2672702f-76e0-4caa-a96b-a58ffca4c553 admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:18.893499 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-2672702f-76e0-4caa-a96b-a58ffca4c553 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.096892 Aug 27 04:01:18.894099 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 36/73] 10.222.0.73 () {60 vars in 1194 bytes} [Fri Aug 27 04:01:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:01:30.743503 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:30.745030 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 27 04:01:30.746085 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 38/74] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 04:01:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:30.941309 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-cb6be289-f54d-49a0-a5b4-c4766896ef51 admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:30.942484 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:01:30.942484 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: warnings.warn(msg) Aug 27 04:01:30.944061 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-f54d-49a0-a5b4-c4766896ef51 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:30.944499 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-f54d-49a0-a5b4-c4766896ef51 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:30.945315 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-f54d-49a0-a5b4-c4766896ef51 admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:30.945742 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-cb6be289-f54d-49a0-a5b4-c4766896ef51 admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:30.970231 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-cb6be289-f54d-49a0-a5b4-c4766896ef51 admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.081213 Aug 27 04:01:30.970741 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 37/75] 10.222.0.73 () {60 vars in 1194 bytes} [Fri Aug 27 04:01:30 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:01:32.373012 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: DEBUG nova.api.openstack.wsgi [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] Calling method '>' {{(pid=93793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:32.374221 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: INFO nova.api.openstack.requestlog [None req-1d398b9f-f886-4f51-a16e-69de2fdee0be admin admin] 10.222.0.73 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Aug 27 04:01:32.374759 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: [pid: 93793|app: 0|req: 39/76] 10.222.0.73 () {56 vars in 1075 bytes} [Fri Aug 27 04:01:32 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:01:32.587723 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG nova.api.openstack.wsgi [None req-9317b8ea-aa2a-470e-bcd6-eb77d427728e admin admin] Calling method '>' {{(pid=93794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:01:32.590528 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:01:32.590528 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: warnings.warn(msg) Aug 27 04:01:32.593420 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-9317b8ea-aa2a-470e-bcd6-eb77d427728e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:32.593879 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-9317b8ea-aa2a-470e-bcd6-eb77d427728e admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:32.595466 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-9317b8ea-aa2a-470e-bcd6-eb77d427728e admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:01:32.595466 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: DEBUG oslo_concurrency.lockutils [None req-9317b8ea-aa2a-470e-bcd6-eb77d427728e admin admin] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:01:32.619085 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: INFO nova.api.openstack.requestlog [None req-9317b8ea-aa2a-470e-bcd6-eb77d427728e admin admin] 10.222.0.73 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.091180 Aug 27 04:01:32.621216 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: [pid: 93794|app: 0|req: 38/77] 10.222.0.73 () {60 vars in 1194 bytes} [Fri Aug 27 04:01:32 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:02:32.736210 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: Fri Aug 27 04:02:32 2021 - graceful shutdown triggered... Aug 27 04:02:32.736948 dv-cinder-804757-2-iscsi devstack@n-api.service[93793]: Gracefully killing worker 1 (pid: 93793)... Aug 27 04:02:32.737423 dv-cinder-804757-2-iscsi devstack@n-api.service[93794]: Gracefully killing worker 2 (pid: 93794)... Aug 27 04:02:32.738382 dv-cinder-804757-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 27 04:02:33.737223 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: worker 1 buried after 1 seconds Aug 27 04:02:33.737223 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: worker 2 buried after 1 seconds Aug 27 04:02:33.737223 dv-cinder-804757-2-iscsi devstack@n-api.service[93792]: goodbye to uWSGI. Aug 27 04:02:33.738870 dv-cinder-804757-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 27 04:02:33.739431 dv-cinder-804757-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 27 04:02:33.743205 dv-cinder-804757-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 27 04:02:33.752969 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 27 04:02:33 2021] *** Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: nodename: dv-cinder-804757-2-iscsi Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: machine: x86_64 Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: clock source: unix Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: pcre jit disabled Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: detected number of CPU cores: 4 Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: current working directory: / Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: detected binary path: /usr/bin/uwsgi-core Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: your processes number limit is 47680 Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: your memory page size is 4096 bytes Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: detected max file descriptor number: 2048 Aug 27 04:02:33.755032 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: lock engine: pthread robust mutexes Aug 27 04:02:33.756418 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: thunder lock: enabled Aug 27 04:02:33.756418 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 27 04:02:33.756418 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 27 04:02:33.807366 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: Python main interpreter initialized at 0x5588ebd769c0 Aug 27 04:02:33.807366 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: python threads support enabled Aug 27 04:02:33.807366 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: your server socket listen backlog is limited to 100 connections Aug 27 04:02:33.807366 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: your mercy for graceful operations on workers is 90 seconds Aug 27 04:02:33.807844 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: mapped 403077 bytes (393 KB) for 2 cores Aug 27 04:02:33.807844 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: *** Operational MODE: preforking *** Aug 27 04:02:33.808113 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: *** uWSGI is running in multiple interpreter mode *** Aug 27 04:02:33.808113 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: spawned uWSGI master process (pid: 108965) Aug 27 04:02:33.808385 dv-cinder-804757-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 27 04:02:33.810600 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: spawned uWSGI worker 1 (pid: 108985, cores: 1) Aug 27 04:02:33.810600 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: spawned uWSGI worker 2 (pid: 108986, cores: 1) Aug 27 04:02:33.810600 dv-cinder-804757-2-iscsi devstack@n-api.service[108965]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 27 04:02:35.678674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:02:35.678674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: from cryptography.utils import int_from_bytes Aug 27 04:02:35.680389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:02:35.680389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: from cryptography.utils import int_from_bytes Aug 27 04:02:35.753426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:02:35.753426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: from cryptography.utils import int_from_bytes Aug 27 04:02:35.754174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 27 04:02:35.754174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: from cryptography.utils import int_from_bytes Aug 27 04:02:38.387722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:02:38.388322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:02:38.388496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:02:38.388873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:02:38.389135 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:02:38.389529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.389858 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.390249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.390625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.390987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.391307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.391696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.392003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.392342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-2-iscsi {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.397990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.399518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.400094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.400289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.400598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.400989 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.401314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.401779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-2-iscsi {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.402111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.402434 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.402791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.403231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.403552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.403939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.404318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.404885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.405293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.405710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.406045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.406376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.406743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.407056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.407375 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.407696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.408042 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.408507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.408829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.409086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.409483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.409855 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.410261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.410632 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.410882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.411175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.411611 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.411988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.412335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.412734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.413060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.413383 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.413712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.414098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.415721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.416064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.416400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.416740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.417081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.417398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.417731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.418147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.418409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.418766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.419122 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.419454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.420026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.420359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.420692 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.421010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.421327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.421643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.421972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.422306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.422646 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.422903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.423215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.423535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.424711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.424711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.424711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.424982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.425095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.425393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.425707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.426019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.426332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.426675 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.426988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.427308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.428215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.428215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.428215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.428537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.428850 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.428948 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 27 04:02:38.429361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.429472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 27 04:02:38.429835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.429935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 27 04:02:38.430174 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.430268 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 27 04:02:38.430445 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 27 04:02:38.430551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.430859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.430969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.431176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.431266 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.431495 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.431593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.431816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.431906 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.432147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.432237 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.432462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.432577 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.432778 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.432870 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.433993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.434137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.434412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804757-2-iscsi {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.434517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.434763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.434924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.435120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.435216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.438799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.438895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.438985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.439982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440056 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440600 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.440990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.441073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.441180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.441277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.441277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.441413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.441492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.441563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.441563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.441728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804757-2-iscsi {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.441800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.441878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.441956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.442037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.442037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.442172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.442172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.442311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.442384 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.442502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.442711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.442960 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.443044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.443317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.443440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.443615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.443743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.443976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.444290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.444407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.444511 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.444624 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.444863 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.445011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.445288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.445576 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.445735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.445921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.446241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.446399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.446553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.446770 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.446884 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.447120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.447215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.447462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.447565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.447729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.447830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.448040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.448146 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.448365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.448471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.448739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.448869 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.449015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.449142 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.449247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.449466 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.449575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.449784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.449885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.450107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.450209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.450421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.450516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.450755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.450859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.451066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.451160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.451374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.451469 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.451683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.451795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.451989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.452092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.452296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.452398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.452601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.452703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.452920 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.453027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.453236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.453338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.453549 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.453648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.453856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.453958 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.454176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.454268 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.454509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.454666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.73 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.454840 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.73 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.454950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.455154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.455341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.455494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.455667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.455828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.455989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.456149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.456295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.456498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.456652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.456809 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.456963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.457115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.457279 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.457425 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.457569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.457723 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.457875 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.458020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.458175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.458328 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.458480 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.458672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.458822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.458973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.459126 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.459272 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.459424 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.459643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.459804 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.459952 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.460104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.460268 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.460432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.460586 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.461505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.461723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.461875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.462032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.462032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.462032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.462468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.462694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.462860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.463029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.463186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.463345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.463498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.463652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.463806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.463951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.464103 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.464257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.464410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.464609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.464609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.464906 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.465083 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.465322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.465473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.465618 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.465798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.465948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.466101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.466270 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.466425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.466589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.466754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.466901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.467045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.467203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.467355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.467507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.467663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.467832 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.467987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.468246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.468246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.468728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.468886 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.469044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.469192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.469345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.469510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.469671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.469823 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.469980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.470125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.470276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.470430 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.470605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.470770 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.470932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.470932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.471391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.471652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.471852 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.472004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.472158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.472303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.472456 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.472694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.472851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.473005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.473150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.473303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.473463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.473618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.473773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.473930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.474086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.474231 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.474385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.474532 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.474729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.474877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.475021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.475166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.475343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.475610 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.475776 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.475934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 27 04:02:38.476080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.476232 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.476492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.477184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.477345 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.477498 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.477794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.477950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.478110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.478258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.478258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.478258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.478732 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.478890 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.479044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.479195 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.479348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.479599 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.479885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.480067 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.480224 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.480377 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.480534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.480679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.480835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.481920 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.482065 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.482216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.482361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.482504 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.482733 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.482892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483478 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483788 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.483933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.484078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.484222 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.484405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.484566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.484721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.484885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.485032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.485177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.485335 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.485480 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.485723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.485876 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.486981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.487128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.487281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.487426 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.487570 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.487721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.487865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488616 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.488971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.489133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.489290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.489435 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.489578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.489722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.489874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.490027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.490173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.490325 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.490470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.490695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.490867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.491025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.491180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.491326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.491470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.491725 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.492078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.492236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.492495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.492642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.492642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.492917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493072 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493695 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.493850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.494271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.494415 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.494588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.494753 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.494907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.495061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.495228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.495382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.495537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.495712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.495949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.496112 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.496266 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.496418 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.496564 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.496722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.496868 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.497935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.498088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.498240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.498393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.498728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.498887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.499045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.499198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.499367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.499530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.499764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.499919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.500065 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.500258 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.500409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.500563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.500710 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.500856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.501906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502675 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.502834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.503199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.503349 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.503513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.503668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.503813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.503966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.504120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.504272 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.504424 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.504577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.504723 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.504882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.505971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.506205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.506371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.506525 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.506714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.506879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.507044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.507196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.507346 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.507514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.507734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.507905 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.508058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.508209 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.508360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.508520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509134 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.509938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.510252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.510411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.510627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.510793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.510967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.511121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.511273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.511424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.511585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.511745 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.511896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512217 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.512994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.513152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.513313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.513475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.513627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.513778 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.513929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.514088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.514251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.514413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.514593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.514763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.514925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.515084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.515249 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.515403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.515562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.515721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.515880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.516039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.516230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.516467 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.516627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.516829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.516993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.517146 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.517306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.517465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.517625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.517776 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.517927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.518087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.518248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.518411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.518605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.518776 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.518938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.519099 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.519252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.519411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.519563 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.519716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.519874 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.520041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.520201 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.520353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.520523 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.520684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.520839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521162 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521466 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.521945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.522105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.522265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.522422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.522619 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.522792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.522945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.523104 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.523760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.523914 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.524064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.524223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.524431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.524628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.524790 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.524944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.525103 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.525282 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.525445 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.525597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.525747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.525899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526209 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526827 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.526980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.527312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.527472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.527472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.527760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.527910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.528079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.528233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.528385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.528536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.528725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.528881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529206 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.529998 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.530151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.530311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.530470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.530721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.530908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.531076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.531230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.531427 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.531628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.531783 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.531949 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.532102 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.532261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.532420 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.532587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.532739 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.532977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.533132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.533291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.533443 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.533443 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.533861 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.534043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.534248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.534437 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.534624 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.534784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.534937 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.535097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.535291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.535458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.535611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.535611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.535919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.536072 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.536223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.536373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.536595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.536595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537207 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537522 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.537993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.538164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.538331 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.538486 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.538709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.538936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.539612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.539765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.539933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.540157 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.540317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.540491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.540650 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.540803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.540974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.541127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.541285 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.541447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.541599 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.541750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.541910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.542918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.543382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.543535 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.543685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.543836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.543993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.544157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.544367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.544536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.544689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.545107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.545260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.545430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.545582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.545742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.545894 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.546055 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.546215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.546367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.546518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.546715 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.546977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.547138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.547290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.547459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.547612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.547770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.547933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.548127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.548287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.548447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.548710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.548884 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.549055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.549215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.549376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.549528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.549705 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.549858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.550025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.550193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.550353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.550520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.550520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.551045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.551203 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.551363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.551560 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.551752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.552001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.552265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.552521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.552769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.553027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.553288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.553533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.553798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.554042 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.554287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.554645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.554910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.555181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.555181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.555659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.555917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.556139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.556319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.556492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.556648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.556802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.557022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.557273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.557437 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.557613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.557774 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.557943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.558095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.558253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.558406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.558590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.558762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.558916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.559067 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.559218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.559370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.559592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.559753 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.559906 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.560995 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.561146 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.561312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.561465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.561626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.561777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.562291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.562768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.562954 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.563110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.563263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.563263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.563561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.563715 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.563875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.564028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.564181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.564381 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.564540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.564720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.564883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.565035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.565194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.565345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.565503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.565746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.565910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.566063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.566232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.566388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.566548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.566757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.566923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.567084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.567254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.567503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.567668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.567835 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.567990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.568155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.568307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.568459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.568621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.568775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.568934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.569107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.569269 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.569428 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.569428 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.569729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.569888 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.570077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.570077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.570373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.570373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.570714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.570877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.571057 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.571226 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.571390 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.571552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.571712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.571872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572349 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572823 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.572976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.573139 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.573301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.573454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.573605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.573757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.573915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.574068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.574229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.574422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.574601 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.574761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.574924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.575078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.575252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.575414 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.575574 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.575726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.575886 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576048 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.576977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.577287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.577440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.577720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.577889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.578060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.578060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.578351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.578510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.578714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.578878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.579045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.579198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.579348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.579525 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.579828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.580014 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.580179 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.580338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.580338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.580338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.580956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.581328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.581490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.581643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.581795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.581959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.581959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.582263 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.582425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.582600 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.582759 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.582923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.583075 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.583238 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.583392 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.583542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.583542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.583831 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.584013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.584166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.584317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.584475 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.584638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.584808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.585013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.585172 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.585332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.585492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.586172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.586348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.586502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.587256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.587421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.587574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.587758 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588327 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588479 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588631 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.588951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.589171 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.589340 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.589507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.589660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.589895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.590053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.590207 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.590367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.590526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.590720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.590889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.591051 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.591237 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.591396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.591561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.591723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.591723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.592034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.592336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.592495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.592649 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.592649 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.592999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.593153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.593153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.593449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.593607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.593607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.593927 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.594080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.594240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.594401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.594554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.594747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.594901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595204 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.595968 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.596118 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.596277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.596438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.596597 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.596757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.596917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.597070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.597070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.597428 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.597597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.597762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.597915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.598173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.598343 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.598507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.598507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.598850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.599013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.599166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.599374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.599540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.599717 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.599901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.600068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.600229 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.600397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.600565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.600730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.600890 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.601049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.601202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.601202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.601202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.601202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.602368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.602606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.602840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.603086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.603295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.603505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.603676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.603839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.604003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.604164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.604326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.604561 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.604726 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.605091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.605253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.605416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.605577 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.605731 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.605891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.606057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.606218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.606376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.606528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.606737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.606737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.607048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.607291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.607496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.607661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.607822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.608026 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.608330 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.608501 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.608654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.608814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.608975 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.609148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.609148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.609446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.609618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.609773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.609925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.610085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.610245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.610397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.610574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.610740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.610974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611466 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.611637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.612221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.612374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.612525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.612676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.612914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.613078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.613231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.613383 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.613533 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.613739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.613913 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.614098 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.614279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.614440 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.614724 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.614910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.615117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.615314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.615565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.615787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.615787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.616095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.616269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.616423 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.616614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.616779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.616961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.617135 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.617299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.617452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.617634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.618092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.618092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.618720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.618956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.619157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.619157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.619716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.619957 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.620155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.620314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.620475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.620644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.620801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.621038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.621263 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.621425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.621595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.621795 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.622045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.622308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.622308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.622775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.623020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.623287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.623287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.623903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.624219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.624484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.624484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.624484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.624484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.625388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.625612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.625844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.626068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.626290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.626290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.626739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.626739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.626739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.627478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.627705 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.627936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.628377 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.628544 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.628860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.629041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.629215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.629396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.629567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.629729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.629902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.630065 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.630239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.630406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.630645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.634475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.634826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.634826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.634826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.634826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.635824 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.636089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.636350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.636571 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.636890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.637174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.637174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.637662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.637662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.638148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.638375 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.638762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.638762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.639380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.639546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.639714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.639871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.640976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.641942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.642322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.642322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.642322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.642553 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.642821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.642927 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643209 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643380 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.643969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644163 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644339 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.644980 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.645988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.646978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.647949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.648677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.648933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.648933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.649216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.649216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.649506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.649666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.649838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.649994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.650929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.651188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.651286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.651389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.651477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.651477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.651910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652187 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.652663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.653812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.654056 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.654056 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.654226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.654314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.654314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.654950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.655912 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.656985 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.657533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.658780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.658977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.659341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.659720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.660146 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.660698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.661066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.662097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.662218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.662218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.662768 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.662880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.663322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.663420 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.663936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.664762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.665072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.665180 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.665389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.665605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.665830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.666159 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.666285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.666735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.668936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.669089 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.669240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.669394 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.669539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.670195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.670353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.670492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.670492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.670762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.670914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.671868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.672872 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.673758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.674016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.674170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.674336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.677942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678387 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.678601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.680481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.680579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.680579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.680801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.680898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.680996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.681091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.681091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.681231 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.682748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.682900 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683108 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683475 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683475 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.683891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.684617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.684777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.684876 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.684974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.685061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.685061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.685551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.685731 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.685830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.685916 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.686514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.686666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.686759 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.686888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.686980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.687376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.687497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.687734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.687919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.688061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.688403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.688507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.688931 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.689048 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.689455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.689576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.689990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.690094 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.690367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.690636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.690738 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.691440 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.691550 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.691638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.691744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.691840 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.691976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.692319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.692422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.692667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.692943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108986) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:02:38.693060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.693320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.693651 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.693984 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.694708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.694822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.695871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.696142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 27 04:02:38.696393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 27 04:02:38.816517 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_db.sqlalchemy.engines [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:38.822703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:38.913161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.context [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b77e019-e5d4-4508-b689-805a75164f6e(cell1) {{(pid=108985) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:02:38.916351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.context [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5b77e019-e5d4-4508-b689-805a75164f6e(cell1) {{(pid=108986) load_cells /opt/stack/nova/nova/context.py:464}} Aug 27 04:02:38.918895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:02:38.920814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:02:38.921667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:02:38.922406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:02:38.925612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:02:38.926221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:02:38.927699 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:02:38.934791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:02:38.938474 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_db.sqlalchemy.engines [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:38.939276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_db.sqlalchemy.engines [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:38.947318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:38.948202 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:39.209544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_db.sqlalchemy.engines [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:39.236510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_db.sqlalchemy.engines [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108986) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 27 04:02:39.585442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: WARNING keystonemiddleware.auth_token [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:02:39.595687 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: WARNING keystonemiddleware.auth_token [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:02:39.600754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: WARNING keystonemiddleware.auth_token [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:02:39.608522 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: WARNING keystonemiddleware.auth_token [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:02:39.979473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: WARNING keystonemiddleware.auth_token [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:02:39.984918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: WARNING keystonemiddleware.auth_token [None req-b9c1f2f8-05de-46d0-83d2-58305ae829bb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:02:39.990127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5588ebd769c0 pid: 108986 (default app) Aug 27 04:02:39.991521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: WARNING keystonemiddleware.auth_token [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 27 04:02:40.002395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: WARNING keystonemiddleware.auth_token [None req-65855439-b526-497c-9515-4d6ba4dc4fd3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 27 04:02:40.013395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5588ebd769c0 pid: 108985 (default app) Aug 27 04:03:16.312292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8671dffa-cb7d-420d-b29a-ce335a6794e4 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Action: 'create', calling method: .version_select at 0x7f53905b3d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1265240238"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:17.637572 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2069732974", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "bd5cbeee-0483-497b-a816-2825652e56f8"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:17.993584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] validate_networks() for [('bd5cbeee-0483-497b-a816-2825652e56f8', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:03:18.822785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:18.823951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:18.823951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:18.824137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:18.824503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:18.847372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:18.847789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:18.848814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:18.849252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:18.876318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8671dffa-cb7d-420d-b29a-ce335a6794e4 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.689778 Aug 27 04:03:18.887339 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 1/1] 10.222.0.73 () {60 vars in 1155 bytes} [Fri Aug 27 04:03:15 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 3699 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 04:03:18.889750 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:18.890762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-51513093-78f1-4598-a5dc-17661e140d3f tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f5390482790>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:18.900295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for user a21ac4ce459d4eee9f73d4c7207968b4 and project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:18.922368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:03:18.929151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:03:19.014372 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-51513093-78f1-4598-a5dc-17661e140d3f tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/192c3990-7dbe-4cce-90bb-ebea761ad8c0" status: 200 len: 350 microversion: 2.1 time: 0.129081 Aug 27 04:03:19.014979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 2/2] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:18 2021] GET /compute/v2.1/os-volumes/192c3990-7dbe-4cce-90bb-ebea761ad8c0 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:19.021142 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c1924cff-a043-4900-99fe-f3985bace88e tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f53904960d0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:19.182170 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-678999e6-315c-4f46-a406-4e518af3e7a7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051780 Aug 27 04:03:19.183577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 1/3] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:03:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 2055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:03:19.196516 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-72dc77f1-8d49-4957-85a2-1e90fbfbb34c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:19.198817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-72dc77f1-8d49-4957-85a2-1e90fbfbb34c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:19.314242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-72dc77f1-8d49-4957-85a2-1e90fbfbb34c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:19.340547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-72dc77f1-8d49-4957-85a2-1e90fbfbb34c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1218 microversion: 2.1 time: 0.148479 Aug 27 04:03:19.341912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:19 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1218 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:19.403350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c1924cff-a043-4900-99fe-f3985bace88e tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b" status: 200 len: 345 microversion: 2.1 time: 0.387145 Aug 27 04:03:19.404260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 3/5] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:19 2021] GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b => generated 345 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:19.641222 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-151855198", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "b29890bd-b6ec-4c54-8b0c-b3b2de6465d6"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:19.754806 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] validate_networks() for [('b29890bd-b6ec-4c54-8b0c-b3b2de6465d6', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:03:20.358056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bd7000d9-8601-484b-82d0-f2a7884f3ed4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:20.359194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bd7000d9-8601-484b-82d0-f2a7884f3ed4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:20.396690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:20.397263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:20.397925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:20.398432 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:20.399131 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:20.409732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:20.410531 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:20.411493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:20.411935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:20.461913 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bd7000d9-8601-484b-82d0-f2a7884f3ed4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:20.468525 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Getting quotas for project a2a4f9dd7d714d20afb13bd273d14061. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:20.474353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Getting quotas for user 3383e658085a4ae1ae783bc3e90e42b4 and project a2a4f9dd7d714d20afb13bd273d14061. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:20.500329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:03:20.503838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:03:20.513167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bd7000d9-8601-484b-82d0-f2a7884f3ed4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1218 microversion: 2.1 time: 0.158316 Aug 27 04:03:20.532867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 4/6] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:20 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:20.548702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-01775a3a-44ba-420b-8a98-ec27f674cced tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f5390482c10>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:20.683070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-50a8d20a-3120-4084-b6a6-ad24ddd112ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.135965 Aug 27 04:03:20.683446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-01775a3a-44ba-420b-8a98-ec27f674cced tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b" status: 200 len: 346 microversion: 2.1 time: 0.147907 Aug 27 04:03:20.683625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 3/7] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:03:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:03:20.697815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c0da7596-c094-48a0-a373-ab3a946672c6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:20.698929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c0da7596-c094-48a0-a373-ab3a946672c6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:20.704332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 5/8] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:20 2021] GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b => generated 346 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:20.727578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4f4ba243-a28f-484e-995e-7c2137f47ca3 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Action: 'create', calling method: .version_select at 0x7f53904569d0>, body: {"snapshot": {"volume_id": "63fc9e47-589c-4e22-aed6-1ba2fc69ba2b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1350293566"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:20.822847 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c0da7596-c094-48a0-a373-ab3a946672c6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:20.849151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c0da7596-c094-48a0-a373-ab3a946672c6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1214 microversion: 2.1 time: 0.155525 Aug 27 04:03:20.850656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 4/9] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:20 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:21.549010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-91978b91-2eb8-4a4b-a093-4677ee708517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:21.551040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-91978b91-2eb8-4a4b-a093-4677ee708517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:21.653248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-91978b91-2eb8-4a4b-a093-4677ee708517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:21.661540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-91978b91-2eb8-4a4b-a093-4677ee708517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1218 microversion: 2.1 time: 0.117971 Aug 27 04:03:21.685224 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 5/10] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:21 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:21.699676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0ad55b90-3014-440c-95e4-29e2eae194f1 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538f378670>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.032118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4f4ba243-a28f-484e-995e-7c2137f47ca3 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.323295 Aug 27 04:03:22.032735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 6/11] 10.222.0.73 () {60 vars in 1162 bytes} [Fri Aug 27 04:03:20 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:22.037049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-23a2a339-bb83-4567-a694-138f9efe5cf3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.037814 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-23a2a339-bb83-4567-a694-138f9efe5cf3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:22.098051 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0ad55b90-3014-440c-95e4-29e2eae194f1 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/9a33b2ce-5010-4096-a20e-9f9ae231bfd0" status: 200 len: 349 microversion: 2.1 time: 0.409799 Aug 27 04:03:22.098992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:21 2021] GET /compute/v2.1/os-volumes/9a33b2ce-5010-4096-a20e-9f9ae231bfd0 => generated 349 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:22.111128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-27debfa6-78d6-4ae5-9af9-bd7be0eea062 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538f376160>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.182116 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-23a2a339-bb83-4567-a694-138f9efe5cf3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:22.189847 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-23a2a339-bb83-4567-a694-138f9efe5cf3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1214 microversion: 2.1 time: 0.156066 Aug 27 04:03:22.197815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:22 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:22.232574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-27debfa6-78d6-4ae5-9af9-bd7be0eea062 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.132035 Aug 27 04:03:22.233499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 7/14] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:22 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:22.244541 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-39994e54-6734-467b-9aa2-43efc40723fe tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f5390496af0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.297253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-39994e54-6734-467b-9aa2-43efc40723fe tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.056015 Aug 27 04:03:22.309205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-02ddb719-b0dc-45d3-b350-4f338fa94c66 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538f344280>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.309857 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 8/15] 10.222.0.73 () {58 vars in 1140 bytes} [Fri Aug 27 04:03:22 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:22.359311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-02ddb719-b0dc-45d3-b350-4f338fa94c66 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.052693 Aug 27 04:03:22.359503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:22 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:22.689124 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:22.689124 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:22.696298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:22.701459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:22.702302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:22.702779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:22.996835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:23.014413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a15f8429-8afc-44b2-b355-981e2bcc1ce9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1214 microversion: 2.1 time: 0.329708 Aug 27 04:03:23.015769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 9/17] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:22 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:23.211202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:23.212433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:23.227940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:23.228566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:23.229581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:23.230169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:23.371627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-942283ad-f86d-4745-81f6-a36e98671be9 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f5390361670>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:23.425164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-942283ad-f86d-4745-81f6-a36e98671be9 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.058399 Aug 27 04:03:23.430445 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 10/18] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:23 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:23.616919 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:23.634940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e1c16124-4524-4b7d-a585-4fceae8a3747 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1210 microversion: 2.1 time: 0.423801 Aug 27 04:03:23.635791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 9/19] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:23 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1210 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:24.036715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:24.037332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:24.064715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:24.064715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:24.064715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:24.064715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:24.228628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:24.240655 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9060e5e9-16b3-47aa-aa0f-04e43be48dc8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1270 microversion: 2.1 time: 0.207672 Aug 27 04:03:24.251407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 11/20] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:24 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:24.437722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f6f3fcec-7282-4e18-a536-8da52c81449b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538f2b7820>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:24.484262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f6f3fcec-7282-4e18-a536-8da52c81449b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.050397 Aug 27 04:03:24.484976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 10/21] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:24 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:24.650502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:24.651151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:24.661560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:24.662318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:24.665142 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:24.665773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:24.927585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:24.936554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0ed60d06-280d-402a-baab-7f72639da75e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1210 microversion: 2.1 time: 0.290415 Aug 27 04:03:24.937950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 12/22] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:24 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1210 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:25.267632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:25.274254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:25.285091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:25.285552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:25.290943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:25.291644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:25.490066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:25.504066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cf7e036e-29f4-464d-b5b4-596e1f7240b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1270 microversion: 2.1 time: 0.244769 Aug 27 04:03:25.505969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-508b3957-5e6f-497a-8140-b27f60d2d52b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f539032b670>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:25.509597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 11/23] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:25 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:25.588217 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-508b3957-5e6f-497a-8140-b27f60d2d52b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.090112 Aug 27 04:03:25.588861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 13/24] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:25 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:25.964869 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:25.965498 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:25.988412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:25.989047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:25.990054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:25.990695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:26.370134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:26.383389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-11d39027-302f-45b3-a26d-dfe75e6d5726 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1210 microversion: 2.1 time: 0.433562 Aug 27 04:03:26.383981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 12/25] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:25 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1210 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:26.524507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:26.529121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:26.533825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:26.534803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:26.535847 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:26.536379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:26.602687 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-949b6486-759a-4016-a6f1-64a2ff7bdc38 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538f376310>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:26.666697 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:26.687325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cc720458-19f0-4db6-b543-291dab0ed92a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1270 microversion: 2.1 time: 0.166931 Aug 27 04:03:26.688290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 14/26] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:26 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:26.712752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-949b6486-759a-4016-a6f1-64a2ff7bdc38 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.114976 Aug 27 04:03:26.722704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 13/27] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:26 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:27.818526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a81e55d6-5094-4ef9-8bbc-a54e2fd5fc79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'create', calling method: .version_select at 0x7f5390e051f0>, body: {"keypair": {"name": "tempest-keypair-1571192423"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:27.837449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-932943675", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a4ff16e-6eb5-4af4-b5ba-1e77e4defb5f"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:27.923807 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-a81e55d6-5094-4ef9-8bbc-a54e2fd5fc79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:27.933220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-a81e55d6-5094-4ef9-8bbc-a54e2fd5fc79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for user 6463ded3d09e4dbd908f0d03b20e0555 and project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:27.945581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] validate_networks() for [('6a4ff16e-6eb5-4af4-b5ba-1e77e4defb5f', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:03:28.263683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-a81e55d6-5094-4ef9-8bbc-a54e2fd5fc79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:28.271609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-a81e55d6-5094-4ef9-8bbc-a54e2fd5fc79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for user 6463ded3d09e4dbd908f0d03b20e0555 and project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:28.304030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a81e55d6-5094-4ef9-8bbc-a54e2fd5fc79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.037632 Aug 27 04:03:28.304825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 15/28] 10.222.0.73 () {62 vars in 1199 bytes} [Fri Aug 27 04:03:27 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1039 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:03:28.318160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:28.321118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:28.360063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:28.360063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:28.366840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:28.370140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:28.502458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:28.512647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f636f0af-21b5-45ce-9c64-cc8d65e6ed66 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1210 microversion: 2.1 time: 0.202686 Aug 27 04:03:28.513584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 16/29] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:28 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1210 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:28.526253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:28.527290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:28.534511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:28.535338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:28.536309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:28.536905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:28.624883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:28.647878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c3893b8b-2656-462d-aaa4-b545b5a0435c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1270 microversion: 2.1 time: 0.127991 Aug 27 04:03:28.649198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 17/30] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:28 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:28.657425 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-37b0a4af-1b73-4aa5-9e10-0ad9dd845b8d tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538fa5b790>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.426879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-37b0a4af-1b73-4aa5-9e10-0ad9dd845b8d tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 288 microversion: 2.1 time: 0.067421 Aug 27 04:03:29.426879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 18/31] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:28 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 288 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:29.426879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f61bca0e-722a-4629-bb42-b6261567b1ab tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538fa5b040>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.433125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:29.433125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:29.433125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:29.433125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:29.433125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:29.436385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:29.436385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:29.436385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:29.436385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:29.438262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Getting quotas for project 5030fe8a997e416683658c321efaef5e. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:29.438262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Getting quotas for user 09ee35f66a4c4cb987f20990e974961f and project 5030fe8a997e416683658c321efaef5e. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:29.438262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:03:29.439229 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:03:29.446079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f61bca0e-722a-4629-bb42-b6261567b1ab tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "DELETE /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 202 len: 0 microversion: 2.1 time: 0.708481 Aug 27 04:03:29.458718 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 19/32] 10.222.0.73 () {58 vars in 1254 bytes} [Fri Aug 27 04:03:28 2021] DELETE /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 0 bytes in 722 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:03:29.494628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-580d8a60-c519-47ad-88e3-92f11d2283a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.166909 Aug 27 04:03:29.495357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 14/33] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:03:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 2190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:03:29.495885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-24cded92-ab44-48c0-81dd-31615dfc5464 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f53903d1d30>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.507621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0ae0a51e-c678-431d-aae4-276d0e72ea6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.508426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0ae0a51e-c678-431d-aae4-276d0e72ea6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:29.566122 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-24cded92-ab44-48c0-81dd-31615dfc5464 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 200 len: 287 microversion: 2.1 time: 0.103909 Aug 27 04:03:29.571488 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 20/34] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:29 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 287 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:29.573137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.573767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:29.590777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:29.592393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:29.598737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:29.598737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:29.676290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0ae0a51e-c678-431d-aae4-276d0e72ea6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:29.686638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0ae0a51e-c678-431d-aae4-276d0e72ea6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1221 microversion: 2.1 time: 0.183757 Aug 27 04:03:29.709743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 15/35] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:29 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:29.740085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:29.744502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:29.765594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:29.772362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:29.776286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:29.776750 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:29.796268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:29.809591 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2916cf25-386b-4485-97e3-77f686eedf0b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1266 microversion: 2.1 time: 0.241376 Aug 27 04:03:29.822374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 21/36] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:29 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:29.855202 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-94ded687-7fc0-4a7b-b790-24cbc064b7ee tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f539032bb80>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:30.021486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:30.040522 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-17b9f5c9-3c92-446c-bfd8-48f79f03d3b2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1278 microversion: 2.1 time: 0.327920 Aug 27 04:03:30.059529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 16/37] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:29 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1278 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:30.113742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-94ded687-7fc0-4a7b-b790-24cbc064b7ee tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/80b5cf26-f2ec-47bb-9c8d-801e2f0042fe" status: 200 len: 350 microversion: 2.1 time: 0.261345 Aug 27 04:03:30.114511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 22/38] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:29 2021] GET /compute/v2.1/os-volumes/80b5cf26-f2ec-47bb-9c8d-801e2f0042fe => generated 350 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:03:30.116529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-910770991", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6a4ff16e-6eb5-4af4-b5ba-1e77e4defb5f"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:30.126653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-42a769cb-38e2-4519-b654-dbc40231daac tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538fa5b4c0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:30.195365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] validate_networks() for [('6a4ff16e-6eb5-4af4-b5ba-1e77e4defb5f', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:03:30.234086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-42a769cb-38e2-4519-b654-dbc40231daac tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.110862 Aug 27 04:03:30.235661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 23/39] 10.222.0.73 () {58 vars in 1134 bytes} [Fri Aug 27 04:03:30 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:30.258385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-650f8746-1fe4-48e4-91f3-3c60ec3f725a tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538fa5bd30>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:30.476090 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-650f8746-1fe4-48e4-91f3-3c60ec3f725a tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.220917 Aug 27 04:03:30.477094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 24/40] 10.222.0.73 () {58 vars in 1149 bytes} [Fri Aug 27 04:03:30 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:30.496211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6c7f9544-cfed-4d86-9fd1-5ef3c54bfffb tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538fa7bca0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:30.713939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6c7f9544-cfed-4d86-9fd1-5ef3c54bfffb tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.227147 Aug 27 04:03:30.714924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 25/41] 10.222.0.73 () {58 vars in 1134 bytes} [Fri Aug 27 04:03:30 2021] GET /compute/v2.1/os-volumes => generated 1032 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:30.730274 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b74c080a-c6d6-4440-9cf7-af1b802e8429 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538fa660d0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:30.811424 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-b74c080a-c6d6-4440-9cf7-af1b802e8429 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] HTTP exception thrown: Snapshot e0d0d77d-4054-49e7-b9be-5a24d9b95e1c could not be found. Aug 27 04:03:30.812254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b74c080a-c6d6-4440-9cf7-af1b802e8429 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Returning 404 to user: Snapshot e0d0d77d-4054-49e7-b9be-5a24d9b95e1c could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:03:30.813342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b74c080a-c6d6-4440-9cf7-af1b802e8429 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c" status: 404 len: 111 microversion: 2.1 time: 0.097088 Aug 27 04:03:30.818812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 26/42] 10.222.0.73 () {58 vars in 1251 bytes} [Fri Aug 27 04:03:30 2021] GET /compute/v2.1/os-snapshots/e0d0d77d-4054-49e7-b9be-5a24d9b95e1c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:30.829687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6d1d9484-41b5-48a1-98a5-bedcec57ca7a tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538fa7bb80>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:31.114145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6d1d9484-41b5-48a1-98a5-bedcec57ca7a tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.292793 Aug 27 04:03:31.125487 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 27/43] 10.222.0.73 () {58 vars in 1167 bytes} [Fri Aug 27 04:03:30 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:31.146049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5f5631ee-d66e-415e-8af2-ae7ef6810db9 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538fa5b820>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:31.516574 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5f5631ee-d66e-415e-8af2-ae7ef6810db9 tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b" status: 202 len: 0 microversion: 2.1 time: 0.393110 Aug 27 04:03:31.516574 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 28/44] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Aug 27 04:03:31 2021] DELETE /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:03:31.530752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:31.535496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:31.559003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:31.559344 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:31.576172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:31.576632 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:31.969187 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:31.983614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-95faab61-ec67-4991-8ce1-adad5678612f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1272 microversion: 2.1 time: 0.468687 Aug 27 04:03:31.984241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 29/45] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:31 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1272 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:32.010705 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:32.011961 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:32.043585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:32.043585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:32.043585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:32.043585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:32.891154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:32.891860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:32.892205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:32.892622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:32.893174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:32.926408 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:32.927456 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:32.932453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:32.932453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:32.952308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:32.963184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0388f506-02fd-4b71-a93e-ce60b9af69e3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.964919 Aug 27 04:03:32.963784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 30/46] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:31 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:32.976482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a036417e-902e-4c18-bd77-24c61da60cc2 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f539036c8b0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.009595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Getting quotas for project 5030fe8a997e416683658c321efaef5e. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:33.026793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Getting quotas for user 09ee35f66a4c4cb987f20990e974961f and project 5030fe8a997e416683658c321efaef5e. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:33.067807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:03:33.071815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:03:33.244242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a036417e-902e-4c18-bd77-24c61da60cc2 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.278995 Aug 27 04:03:33.245023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 31/47] 10.222.0.73 () {58 vars in 1170 bytes} [Fri Aug 27 04:03:32 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:33.262698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-427031a9-4b9c-4852-afcc-52b14a09697d tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538fa7b0d0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.338974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-427031a9-4b9c-4852-afcc-52b14a09697d tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] HTTP exception thrown: Volume 63fc9e47-589c-4e22-aed6-1ba2fc69ba2b could not be found. Aug 27 04:03:33.340093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-427031a9-4b9c-4852-afcc-52b14a09697d tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Returning 404 to user: Volume 63fc9e47-589c-4e22-aed6-1ba2fc69ba2b could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:03:33.341483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-427031a9-4b9c-4852-afcc-52b14a09697d tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b" status: 404 len: 109 microversion: 2.1 time: 0.095229 Aug 27 04:03:33.342510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 32/48] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:33 2021] GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:33.357382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.361837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:33.364584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9656d38a-ea40-4817-b43a-1f7ff0c920d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.258645 Aug 27 04:03:33.366812 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 17/49] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:03:30 2021] POST /compute/v2.1/servers => generated 383 bytes in 3263 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:03:33.396332 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-26ad8a18-0620-440c-94ab-c5533ae8f577 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f5390e03160>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.396615 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:33.397608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:33.398388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:33.398851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:33.722251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-26ad8a18-0620-440c-94ab-c5533ae8f577 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.354044 Aug 27 04:03:33.730451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 18/50] 10.222.0.73 () {58 vars in 1155 bytes} [Fri Aug 27 04:03:33 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:33.735352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f2b4e725-f703-44d9-b17e-ee9592654c7b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538f2b78b0>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.816912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-f2b4e725-f703-44d9-b17e-ee9592654c7b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] HTTP exception thrown: Volume 63fc9e47-589c-4e22-aed6-1ba2fc69ba2b could not be found. Aug 27 04:03:33.817839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f2b4e725-f703-44d9-b17e-ee9592654c7b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Returning 404 to user: Volume 63fc9e47-589c-4e22-aed6-1ba2fc69ba2b could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:03:33.818993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f2b4e725-f703-44d9-b17e-ee9592654c7b tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b" status: 404 len: 109 microversion: 2.1 time: 0.087362 Aug 27 04:03:33.819714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 19/51] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Aug 27 04:03:33 2021] DELETE /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:33.826339 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fdf97954-875c-4813-8502-b65a4fc71cc0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:33.827789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fdf97954-875c-4813-8502-b65a4fc71cc0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:33.960515 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:33.973287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2f182e90-5781-423c-8db6-4ef3cd0e302d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1272 microversion: 2.1 time: 0.629484 Aug 27 04:03:33.981234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 33/52] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:33 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1272 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:33.998138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-433d4d8e-241e-43a2-b597-bfcdf5c6be10 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538fa5bf70>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.158916 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fdf97954-875c-4813-8502-b65a4fc71cc0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:34.179218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fdf97954-875c-4813-8502-b65a4fc71cc0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1221 microversion: 2.1 time: 0.358073 Aug 27 04:03:34.179983 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 20/53] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:33 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1221 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:34.185010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-775554cd-852d-4229-95eb-b509fa22157a tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Calling method '.version_select at 0x7f538f281040>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.260458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-775554cd-852d-4229-95eb-b509fa22157a tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] HTTP exception thrown: Volume 63fc9e47-589c-4e22-aed6-1ba2fc69ba2b could not be found. Aug 27 04:03:34.261294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-775554cd-852d-4229-95eb-b509fa22157a tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] Returning 404 to user: Volume 63fc9e47-589c-4e22-aed6-1ba2fc69ba2b could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:03:34.268106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-775554cd-852d-4229-95eb-b509fa22157a tempest-VolumesSnapshotsTestJSON-1770353830 tempest-VolumesSnapshotsTestJSON-1770353830-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b" status: 404 len: 109 microversion: 2.1 time: 0.084915 Aug 27 04:03:34.270308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 21/54] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:03:34 2021] GET /compute/v2.1/os-volumes/63fc9e47-589c-4e22-aed6-1ba2fc69ba2b => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:03:34.297262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.297901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:34.320758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:34.344492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:34.345498 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:34.351921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:34.386925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-433d4d8e-241e-43a2-b597-bfcdf5c6be10 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.404218 Aug 27 04:03:34.396020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 34/55] 10.222.0.73 () {58 vars in 1188 bytes} [Fri Aug 27 04:03:33 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:34.407011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-577afaef-c143-4f0c-9d3e-d241138ad423 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] Calling method '.version_select at 0x7f538fa7b670>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.594410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-577afaef-c143-4f0c-9d3e-d241138ad423 tempest-VolumesTestJSON-729725862 tempest-VolumesTestJSON-729725862-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.196630 Aug 27 04:03:34.608115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 35/56] 10.222.0.73 () {58 vars in 1155 bytes} [Fri Aug 27 04:03:34 2021] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:34.901655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:34.913844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-00e24fd6-a8a1-47bf-ac79-19d86e90da13 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.641300 Aug 27 04:03:34.917265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 22/57] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:34 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:34.997568 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:34.998958 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:35.012981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:35.013701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:35.014685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:35.015742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:35.151596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:35.166298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-521b8cad-d571-4897-8939-6a374f2dfaab tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1272 microversion: 2.1 time: 0.170398 Aug 27 04:03:35.170169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 36/58] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:34 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:35.206601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0c8dab23-af58-4136-86e8-1048541e8d19 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:35.208066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0c8dab23-af58-4136-86e8-1048541e8d19 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:35.328772 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0c8dab23-af58-4136-86e8-1048541e8d19 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:35.340709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0c8dab23-af58-4136-86e8-1048541e8d19 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1221 microversion: 2.1 time: 0.147303 Aug 27 04:03:35.341645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 23/59] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:35 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1221 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:35.941453 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:35.942201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:35.954297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:35.954297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:35.955750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:35.957083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:36.196213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:36.202768 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:36.226444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:36.228073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:36.243143 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:36.244211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:37.289882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:37.336219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-13ab7cdd-d6ed-42e0-a36d-e160294d46f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 1.398756 Aug 27 04:03:37.339489 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 37/60] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:35 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:37.358247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:37.358916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:37.366132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:37.367088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:37.368223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:37.369020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:37.609402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:37.633799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7b69983f-5d1b-408c-8620-351a1612242a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1217 microversion: 2.1 time: 0.292746 Aug 27 04:03:37.644851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 38/61] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:37 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1217 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:37.708420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:37.720841 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9256da1e-fc35-448e-8da8-ace219ad5d83 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 1.528725 Aug 27 04:03:37.722444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 24/62] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:36 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:37.930777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-5101fc0d-9dda-4945-a56f-fb0c182e5ffd req-41baa75d-93af-4d9d-8b2c-8e1fd29d8008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "664ae18c-f051-4b0e-a20b-d77df52d1a1a", "tag": "8e4eacb7-9daf-4803-972f-81d8c117a2c4"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:37.933631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:37.933631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:03:37.962442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-5101fc0d-9dda-4945-a56f-fb0c182e5ffd req-41baa75d-93af-4d9d-8b2c-8e1fd29d8008 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:37.962442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-5101fc0d-9dda-4945-a56f-fb0c182e5ffd req-41baa75d-93af-4d9d-8b2c-8e1fd29d8008 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:38.016127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-5101fc0d-9dda-4945-a56f-fb0c182e5ffd req-41baa75d-93af-4d9d-8b2c-8e1fd29d8008 service nova] Creating event network-changed:8e4eacb7-9daf-4803-972f-81d8c117a2c4 for instance 664ae18c-f051-4b0e-a20b-d77df52d1a1a on hv-cinder-80475 Aug 27 04:03:38.016669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-5101fc0d-9dda-4945-a56f-fb0c182e5ffd req-41baa75d-93af-4d9d-8b2c-8e1fd29d8008 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108986) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 04:03:38.017874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:38.018447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:38.019570 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:38.020164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:38.051374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.compute.rpcapi [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 04:03:38.051374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] Releasing lock "compute-rpcapi-router" {{(pid=108986) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 04:03:38.116407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ff27da44-3677-441e-9860-90e51e29d7b4 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.469410 Aug 27 04:03:38.117964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 39/63] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:38.357741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:38.358613 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:38.376562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:38.377026 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:38.377818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:38.378260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:38.695934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:38.695934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:38.695934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:38.695934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:38.696728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:38.696728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:39.003097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:39.013001 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4918b7f9-eeda-45e3-9767-229a1e0747b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.364037 Aug 27 04:03:39.019432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 40/64] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:38 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:39.029759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:39.030657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:39.038979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:39.040022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:39.041189 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:39.041883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:39.058460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:39.068243 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6f7e8204-2afb-4f30-a289-e7a50f908319 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.715059 Aug 27 04:03:39.070297 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 25/65] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:38 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:39.090540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-953793792", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae738068-a8df-43ab-a247-dfe7ca6ceb64"}], "security_groups": [{"name": "tempest-securitygroup--1776527638"}], "key_name": "tempest-keypair-1571192423", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:39.272481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] validate_networks() for [('ae738068-a8df-43ab-a247-dfe7ca6ceb64', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:03:39.298008 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:39.320726 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f52e11f7-c91a-4e39-b312-f86ebc0b5f67 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.299750 Aug 27 04:03:39.322671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 41/66] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:39 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:39.898373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:03:39.898968 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:03:39.899711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:03:39.900217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:03:39.900917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:03:39.914107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:39.914500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:39.915628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:39.915776 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:39.952211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:03:39.955229 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for user 6463ded3d09e4dbd908f0d03b20e0555 and project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:03:39.969351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:03:39.971551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:03:40.031701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:40.032559 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:40.038840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.039300 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.040114 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.040536 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.125158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.135630 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-33c650c3-bd28-43dc-8198-c74a265b26c1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.107355 Aug 27 04:03:40.136473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 42/67] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:40 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:40.142025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:40.142802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:40.157802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.158366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.161631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.162272 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.405540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6c79a0d9-74f8-4431-a4aa-1dcbf785a9e9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.319425 Aug 27 04:03:40.410322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 26/68] 10.222.0.73 () {62 vars in 1188 bytes} [Fri Aug 27 04:03:39 2021] POST /compute/v2.1/servers => generated 402 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:03:40.416094 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:40.416726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:40.436215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.444145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.444145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.444145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.446404 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.457457 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8875c7e7-460d-4b87-92fd-6c44807fb9b1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.319933 Aug 27 04:03:40.462467 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 43/69] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:40 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:40.486454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f689261e-4d01-4139-ac35-fb9600f87e36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:40.491710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f689261e-4d01-4139-ac35-fb9600f87e36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:40.633245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f689261e-4d01-4139-ac35-fb9600f87e36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.641873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f689261e-4d01-4139-ac35-fb9600f87e36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.643782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f689261e-4d01-4139-ac35-fb9600f87e36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.645821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f689261e-4d01-4139-ac35-fb9600f87e36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1281 microversion: 2.20 time: 0.181916 Aug 27 04:03:40.647158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 44/70] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:40 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:40.860447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-d56edabe-dec8-48d1-b59e-f8ebcd8fd445 req-e2924a26-50ae-40a0-a61b-7a20c91906aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3023b951-fa8f-4235-ac32-1423097b35cd", "tag": "8d437acd-33d0-47b8-9d2f-3680430a75b6"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:40.862293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:40.862293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:03:40.877355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-d56edabe-dec8-48d1-b59e-f8ebcd8fd445 req-e2924a26-50ae-40a0-a61b-7a20c91906aa service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:40.882037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-d56edabe-dec8-48d1-b59e-f8ebcd8fd445 req-e2924a26-50ae-40a0-a61b-7a20c91906aa service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:40.929476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-d56edabe-dec8-48d1-b59e-f8ebcd8fd445 req-e2924a26-50ae-40a0-a61b-7a20c91906aa service nova] Creating event network-changed:8d437acd-33d0-47b8-9d2f-3680430a75b6 for instance 3023b951-fa8f-4235-ac32-1423097b35cd on hv-cinder-80475 Aug 27 04:03:40.932972 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:40.942467 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-976ffc78-ce00-48bc-8b0d-16cb1e6d8c8c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.534849 Aug 27 04:03:40.943431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 27/71] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:40 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:40.946317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-d56edabe-dec8-48d1-b59e-f8ebcd8fd445 req-e2924a26-50ae-40a0-a61b-7a20c91906aa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296381 Aug 27 04:03:40.959076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 45/72] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:41.153442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:41.154095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:41.160553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:41.161009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:41.161909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:41.163394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:41.247776 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.259698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-42df10b6-7bf7-4eda-af0f-b2bd92b603aa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.110056 Aug 27 04:03:41.260556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 28/73] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:41 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:41.477902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:41.478608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:41.494465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:41.495069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:41.495849 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:41.496296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:41.671654 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-03651496-784d-4c66-aca4-83a949ed17b5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:41.673236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-03651496-784d-4c66-aca4-83a949ed17b5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:41.736118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.750901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a465b20f-a7dc-4d05-9bda-ff712d1fa077 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.276077 Aug 27 04:03:41.751853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 46/74] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:41 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:41.764899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-03651496-784d-4c66-aca4-83a949ed17b5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.776836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-03651496-784d-4c66-aca4-83a949ed17b5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.779170 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-03651496-784d-4c66-aca4-83a949ed17b5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:41.788185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-03651496-784d-4c66-aca4-83a949ed17b5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1281 microversion: 2.20 time: 0.119853 Aug 27 04:03:41.788185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 29/75] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:41 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:41.966120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:41.967332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:42.003248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.003248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.003248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.003248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.280316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:42.281457 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:42.294798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.295636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.296893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.297591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.341943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.351791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-476ee3d6-4ad2-40de-9c26-ae3eab020fef tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.391945 Aug 27 04:03:42.352702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 47/76] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:41 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:42.399577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.413035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-10de2b46-3d39-47b7-b5af-926c29a98285 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.137485 Aug 27 04:03:42.427125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 30/77] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:42 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:42.787155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:42.789861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:42.797846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.798392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.799517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.800023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.821887 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:42.823632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:42.833022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.838183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.840676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:42.845493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:42.937695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.948233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.951584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:42.952981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-078beca9-bb70-4c44-8d0d-d053f83ab804 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1285 microversion: 2.20 time: 0.137710 Aug 27 04:03:42.953876 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 31/78] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:42 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:42.989140 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-38ad3246-dc47-4578-8895-7fd927cb7b43 req-ba22b0b4-a0ed-48db-876d-ef8d94da754a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "715a2f59-8055-4b6e-a32f-07a45609c931", "tag": "dcd7a2b9-30fd-43d0-85c6-38a70773fb11"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:42.993668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:42.993668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:03:43.016161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-38ad3246-dc47-4578-8895-7fd927cb7b43 req-ba22b0b4-a0ed-48db-876d-ef8d94da754a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.017562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-38ad3246-dc47-4578-8895-7fd927cb7b43 req-ba22b0b4-a0ed-48db-876d-ef8d94da754a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.027501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:43.036753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-eaca0924-3260-422c-b88f-f27ba1cbf7f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.253700 Aug 27 04:03:43.039735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 48/79] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:42 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:43.064318 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-38ad3246-dc47-4578-8895-7fd927cb7b43 req-ba22b0b4-a0ed-48db-876d-ef8d94da754a service nova] Creating event network-changed:dcd7a2b9-30fd-43d0-85c6-38a70773fb11 for instance 715a2f59-8055-4b6e-a32f-07a45609c931 on hv-cinder-80475 Aug 27 04:03:43.064990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-38ad3246-dc47-4578-8895-7fd927cb7b43 req-ba22b0b4-a0ed-48db-876d-ef8d94da754a service nova] Acquired lock "compute-rpcapi-router" {{(pid=108985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 27 04:03:43.066786 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.068023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.070062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.092277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.132754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.compute.rpcapi [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 27 04:03:43.137990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] Releasing lock "compute-rpcapi-router" {{(pid=108985) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 27 04:03:43.167224 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cdb842cb-c3ea-41f4-ab5a-dcd5ae3d6e37 None None] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184282 Aug 27 04:03:43.168314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 32/80] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:43.373126 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:43.373730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:43.380186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.386688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.386688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.386688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.432232 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:43.434301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:43.439860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.440413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.441195 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:43.441623 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:43.592856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:43.605409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-23b55224-dc37-425a-b11e-8499eda6fa1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.177347 Aug 27 04:03:43.605998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 33/81] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:43 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:43.624047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:43.634773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-492655f1-8f73-4ffc-8862-81e68d733bd8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.265080 Aug 27 04:03:43.635890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 49/82] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:43 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:43.979326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:43.980023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:44.004675 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.005347 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.006805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.010338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.058968 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:44.072909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:44.142994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.142994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.142994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.142994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.143317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.143317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.148637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.150139 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-20bc6a56-2214-498b-96f1-4700fed2faff tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1285 microversion: 2.20 time: 0.181456 Aug 27 04:03:44.151127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 34/83] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:43 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:44.309326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.317847 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1f3ede78-95b5-4e84-b336-fa9371245f2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.264800 Aug 27 04:03:44.320000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 50/84] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:44 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:44.623028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:44.624417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:44.633294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.634218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.635357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.639559 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.654338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:44.655334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:44.664513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.665899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.667004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:44.668063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:44.750270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.761514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f7e92c2d-0de8-4358-9d94-ce9814d7cfb0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.142208 Aug 27 04:03:44.767295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 35/85] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:44 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:44.890247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:44.902046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a3a6df8e-c98b-4b3e-bea1-f16145695e35 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.251287 Aug 27 04:03:44.902829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 51/86] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:44 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:45.194261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:45.198392 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:45.226243 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.235312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.236156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.236594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.319770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:45.327754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:45.331878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:45.331878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7bf382da-eb33-4537-9740-b9b4e77104eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1285 microversion: 2.20 time: 0.148684 Aug 27 04:03:45.331878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 36/87] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:45 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:45.337527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:45.338139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:45.346471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.347218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.348223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.348713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.543861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:45.552797 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0f084f0e-0849-495a-ab07-d4be562af101 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.219540 Aug 27 04:03:45.564633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 52/88] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:45 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:45.777689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:45.779964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:45.784362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.791847 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.791847 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.791847 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.870266 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:45.877809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-74a4b1f1-a516-4bb7-a1a8-cce360ba6d12 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.103863 Aug 27 04:03:45.888426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 37/89] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:45 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:45.922751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:45.923393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:45.930923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.931964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:45.932711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:45.933438 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:46.091689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:46.099245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ac655a3b-84d6-41a8-8d0a-54c068d8d22b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.180419 Aug 27 04:03:46.100542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 53/90] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:45 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:46.353737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:46.354399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:46.360419 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:46.360920 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:46.361690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:46.362124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:46.422396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:46.431529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:46.433331 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:46.434420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bb6fc995-c6c0-41dc-ac1e-9750fe937167 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1285 microversion: 2.20 time: 0.085764 Aug 27 04:03:46.434994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 38/91] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:46 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1285 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:46.574246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:46.576160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:46.586315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:46.586819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:46.588256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:46.588996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:46.896074 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:46.896961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:46.905259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:46.905698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:46.906791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:46.907393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:47.111205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.124565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-019ee981-7d16-43fa-bac1-b043e4ebf03e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.555930 Aug 27 04:03:47.125194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 54/92] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:46 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:47.138315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:47.139160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:47.140566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.149011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6489e33a-23f6-46e1-91c3-a1dd0011fa70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1281 microversion: 2.1 time: 0.256327 Aug 27 04:03:47.150780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 39/93] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:46 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1281 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:47.161010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:47.161010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:47.161010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:47.161010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:47.454910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:47.455860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:47.462524 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:47.463134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:47.464012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:47.464824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:47.565468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.589672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.597861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-926df51d-2182-4386-97f3-824a8dc0e07a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.471583 Aug 27 04:03:47.598451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 55/94] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:47 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:47.614654 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.617341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:47.619029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a1abca03-7ff2-44da-8f5f-f0409d30083d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1277 microversion: 2.20 time: 0.169769 Aug 27 04:03:47.619709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 40/95] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:47 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:48.141335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:48.141955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:48.149365 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.149824 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.150657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.151101 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.169102 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:48.169988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:48.177387 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.177867 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.179090 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.179536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.820095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:48.832322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-11c38465-ab8d-4f1e-b185-6abd88af19cf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.693803 Aug 27 04:03:48.833609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 56/96] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:48 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:48.840988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:48.842276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:48.855790 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.857592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.859315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.870025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.877777 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:48.891376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f1d07526-50b6-41dc-aad1-b18002febba2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.725449 Aug 27 04:03:48.893398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 41/97] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:48 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:48.904822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:48.907271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:48.918011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.918465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:48.920064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:48.921035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:49.029390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:49.045961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:49.048987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:49.051406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1752676a-9883-4c2b-b5a4-bfd0fcc2f47e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1341 microversion: 2.20 time: 0.156042 Aug 27 04:03:49.054775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 42/98] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:48 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:49.286167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:49.308732 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5ae62ec4-d3dc-4dcc-bafc-b0497db9b5c4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.473144 Aug 27 04:03:49.311736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 57/99] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:48 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:49.851934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:49.852537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:49.868199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:49.868897 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:49.869908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:49.870821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:49.909147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:49.910490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:49.918659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:49.919765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:49.920825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:49.921516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:50.354716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:50.363371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-980de2d2-2416-4b8e-95a4-0b8c4e64529b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.516400 Aug 27 04:03:50.366246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 43/100] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:49 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:50.371092 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:50.371790 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:50.379113 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:50.379113 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:50.379746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:50.380129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:50.402535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:50.411203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-495528b2-8014-4b9e-a8db-51df7b1c58cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.505804 Aug 27 04:03:50.422435 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 58/101] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:49 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:50.427060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:50.428496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:50.434765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:50.435357 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:50.436558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:50.437236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:50.519299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:50.527860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:50.529840 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:50.531374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aa1d9ed1-ae2a-4f9f-b567-6ed704f71ec0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1339 microversion: 2.20 time: 0.165212 Aug 27 04:03:50.543949 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 44/102] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:50 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1339 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:50.556861 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-4e5732ed-0f58-4cd4-84f3-9306909abcc1 req-0efc0804-58ee-4e7b-8f98-cb6b97a41fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb527b41-c9a1-4ffd-861a-e7ed1dcd796f", "tag": "8697a5a5-f72a-4cef-ae30-99ffc017de8e"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:50.558608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:50.558608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:03:50.566177 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-4e5732ed-0f58-4cd4-84f3-9306909abcc1 req-0efc0804-58ee-4e7b-8f98-cb6b97a41fe8 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:50.566646 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-4e5732ed-0f58-4cd4-84f3-9306909abcc1 req-0efc0804-58ee-4e7b-8f98-cb6b97a41fe8 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:50.579437 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-4e5732ed-0f58-4cd4-84f3-9306909abcc1 req-0efc0804-58ee-4e7b-8f98-cb6b97a41fe8 service nova] Creating event network-changed:8697a5a5-f72a-4cef-ae30-99ffc017de8e for instance fb527b41-c9a1-4ffd-861a-e7ed1dcd796f on hv-cinder-80475 Aug 27 04:03:50.585355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-4e5732ed-0f58-4cd4-84f3-9306909abcc1 req-0efc0804-58ee-4e7b-8f98-cb6b97a41fe8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039265 Aug 27 04:03:50.586349 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 45/103] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:51.023970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:51.039207 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fb164fb0-afec-4d30-8b91-7a3682b03e94 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.622885 Aug 27 04:03:51.039789 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 59/104] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:50 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:51.383805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:51.384815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:51.391321 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:51.391746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:51.392545 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:51.392986 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:51.429666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:51.430699 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:51.437044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:51.437680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:51.438356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:51.439025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:51.806781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:51.816121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-99a0255e-09e6-4f54-8215-361b0ed47884 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.390299 Aug 27 04:03:51.818014 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:51.819242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 60/105] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:51 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:51.827281 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:51.828114 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:51.829504 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-037efa06-aba8-4df2-956d-4f3c3053f0d4 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.449956 Aug 27 04:03:51.832692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 46/106] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:51 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:51.843882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:51.844569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:51.845641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:51.846216 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:52.059552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:52.065052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:52.066719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:52.067546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:52.068461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:52.069198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:52.405574 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:52.428605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:52.432697 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:52.437080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1ff98b58-ffee-48b6-951c-1504f788db13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.614180 Aug 27 04:03:52.437902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 61/107] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:51 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:52.586527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:52.596901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-118922f2-9953-4edd-8351-25b3a2285737 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.540701 Aug 27 04:03:52.597855 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 47/108] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:52 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:52.844353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:52.845227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:52.848931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:52.850299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:52.853623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:52.854070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:52.855091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:52.855529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:52.860500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:52.860964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:52.863810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:52.864261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:53.660022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:53.669322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ffec2446-42fa-4d55-9608-d5a39cabe1c6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.823938 Aug 27 04:03:53.689669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 48/109] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:52 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:53.696077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:53.697012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:53.705803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:53.714529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a76dd489-1a44-4775-94c6-d9849fae7dda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.882917 Aug 27 04:03:53.715139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 62/110] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:52 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:53.732473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:53.732663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:53.734342 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:53.735254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:53.735629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:53.736462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:53.757293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:53.757293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:53.757293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:53.757293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:53.985327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:54.013505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3b725e23-0127-42a7-a393-43b27ad3e649 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.288319 Aug 27 04:03:54.013505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 63/111] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:53 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:54.017789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:54.030679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:54.032542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:54.034363 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ec4e64be-7663-456c-87b8-662d276e6e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.343046 Aug 27 04:03:54.042087 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 49/112] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:53 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:54.053907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-050c815d-c57c-406c-b458-394e19e2e7a4 req-ddee1ff7-2cf6-4665-8f04-5d35e1ab632d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:54.053907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:54.053907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:03:54.061890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-050c815d-c57c-406c-b458-394e19e2e7a4 req-ddee1ff7-2cf6-4665-8f04-5d35e1ab632d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:54.062501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-050c815d-c57c-406c-b458-394e19e2e7a4 req-ddee1ff7-2cf6-4665-8f04-5d35e1ab632d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:54.079525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-050c815d-c57c-406c-b458-394e19e2e7a4 req-ddee1ff7-2cf6-4665-8f04-5d35e1ab632d service nova] Creating event network-changed:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:03:54.085678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-050c815d-c57c-406c-b458-394e19e2e7a4 req-ddee1ff7-2cf6-4665-8f04-5d35e1ab632d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050193 Aug 27 04:03:54.086307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 64/113] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:54.695721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:54.696341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:54.703524 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:54.703980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:54.704769 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:54.705207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:54.739765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:54.741918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:54.749896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:54.750719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:54.751738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:54.752392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:55.108898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.117100 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2192eb5d-a01a-49f5-bf29-e3a5ae489e41 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.425983 Aug 27 04:03:55.117694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 50/114] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:54 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:55.122103 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:55.122956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:55.132259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:55.132871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:55.133675 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:55.136953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.140726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:55.148254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-00b2e194-ec01-4fc1-ba95-47489de263a2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.419892 Aug 27 04:03:55.148848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 65/115] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:54 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:55.159410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:55.171433 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:55.187522 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:55.189238 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:55.192687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:55.195717 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:55.400849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.403084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.410369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3330b6d7-5bb5-46bd-add0-d902958129fd tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.291611 Aug 27 04:03:55.411123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 51/116] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:55 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:55.414240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.415871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:55.417005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1f117022-d232-4d48-a8a0-8f635d1f0b48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.267200 Aug 27 04:03:55.417551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 66/117] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:55 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:56.138871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:56.139578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:56.150755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.150755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.150755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.150755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.173750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:56.179794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:56.196084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.196837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.197984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.198950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.415408 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.424208 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a385baa8-bfab-48f7-a3cb-c02fb1c412a1 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.290851 Aug 27 04:03:56.444259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 52/118] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:56 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:56.464293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:56.469868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:56.487103 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.487565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.491313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.491931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.572283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.580150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-83b9e164-0185-48a7-8b14-f535d4db09b7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.417358 Aug 27 04:03:56.580835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 67/119] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:56 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:56.593988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:56.595867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:56.606648 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.607371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.608780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:56.609790 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:56.720729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.734081 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0d7eda43-07da-48f7-b55d-657bf67960b4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.286068 Aug 27 04:03:56.738414 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 53/120] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:56 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:56.793982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.810398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.811230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:56.812435 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f5d0d8c6-3b60-4dbc-8417-0a9cefd27880 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.230425 Aug 27 04:03:56.813079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 68/121] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:56 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:57.219219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-90e95e90-33ca-4281-89d1-ae6653cbec8b req-a145a5e9-97f6-47fe-bb64-39212aecb39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664ae18c-f051-4b0e-a20b-d77df52d1a1a", "name": "network-vif-plugged", "status": "completed", "tag": "8e4eacb7-9daf-4803-972f-81d8c117a2c4"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:57.220996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:57.220996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:03:57.229199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-90e95e90-33ca-4281-89d1-ae6653cbec8b req-a145a5e9-97f6-47fe-bb64-39212aecb39c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.229712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-90e95e90-33ca-4281-89d1-ae6653cbec8b req-a145a5e9-97f6-47fe-bb64-39212aecb39c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.241660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-90e95e90-33ca-4281-89d1-ae6653cbec8b req-a145a5e9-97f6-47fe-bb64-39212aecb39c service nova] Creating event network-vif-plugged:8e4eacb7-9daf-4803-972f-81d8c117a2c4 for instance 664ae18c-f051-4b0e-a20b-d77df52d1a1a on hv-cinder-80475 Aug 27 04:03:57.246681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-90e95e90-33ca-4281-89d1-ae6653cbec8b req-a145a5e9-97f6-47fe-bb64-39212aecb39c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087048 Aug 27 04:03:57.247284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 54/122] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:57.449411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:57.451055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:57.457189 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.457633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.466201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.466201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.606644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:57.617778 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:57.649787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.650298 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.654188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.654966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.699745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:57.713448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4e5342e7-d21e-456b-8b1c-aae40ba4561c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.266291 Aug 27 04:03:57.725703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 69/123] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:57 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:57.754391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:57.755150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:57.774226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.774817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.775688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.776198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.956578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:57.966936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-90707a3e-6283-47ed-9448-bca680fb6f0e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.364575 Aug 27 04:03:57.967520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 55/124] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:57 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:57.971872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:57.972479 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:57.983846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.984472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:57.985398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:57.985978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:58.029382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.050008 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f4d61975-9309-43b2-8b90-142bf0b119e8 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.298680 Aug 27 04:03:58.051894 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 70/125] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:57 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:58.197924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.209724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.212996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.214943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3b405aaa-628d-491f-bc63-a3e217741abf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.246164 Aug 27 04:03:58.215959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 56/126] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:57 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:58.733572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:58.734365 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:58.740932 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:58.741460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:58.742505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:58.743121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:58.924311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:58.938647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d84b3789-168e-4bbb-b1f5-a571b5e0cb69 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.208003 Aug 27 04:03:58.949772 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 71/127] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:58 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:58.985837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:58.986457 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:58.998681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:58.999200 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:58.999997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.000438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.067795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:59.068449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:59.074830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.075275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.076243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.076677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.201174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.211837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5e373d5f-2640-4684-b8f6-2e06ff87288b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.231022 Aug 27 04:03:59.212427 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 57/128] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:58 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:03:59.234432 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:59.235496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:59.244333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.244333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.244333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.244333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.336676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.346014 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6cc98b1d-f02b-4744-b68b-004961cced36 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.281980 Aug 27 04:03:59.347622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 72/129] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:59 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:03:59.353659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-c0d8f950-c20b-4494-bbec-de771aef320c req-550faf0f-b79f-48fe-9b8f-0f0c4be78abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3023b951-fa8f-4235-ac32-1423097b35cd", "name": "network-vif-plugged", "status": "completed", "tag": "8d437acd-33d0-47b8-9d2f-3680430a75b6"}, {"server_uuid": "715a2f59-8055-4b6e-a32f-07a45609c931", "name": "network-vif-plugged", "status": "completed", "tag": "dcd7a2b9-30fd-43d0-85c6-38a70773fb11"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:03:59.356077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:03:59.356077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:03:59.373264 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-c0d8f950-c20b-4494-bbec-de771aef320c req-550faf0f-b79f-48fe-9b8f-0f0c4be78abb service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.373707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-c0d8f950-c20b-4494-bbec-de771aef320c req-550faf0f-b79f-48fe-9b8f-0f0c4be78abb service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.388830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-c0d8f950-c20b-4494-bbec-de771aef320c req-550faf0f-b79f-48fe-9b8f-0f0c4be78abb service nova] Creating event network-vif-plugged:8d437acd-33d0-47b8-9d2f-3680430a75b6 for instance 3023b951-fa8f-4235-ac32-1423097b35cd on hv-cinder-80475 Aug 27 04:03:59.389440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-c0d8f950-c20b-4494-bbec-de771aef320c req-550faf0f-b79f-48fe-9b8f-0f0c4be78abb service nova] Creating event network-vif-plugged:dcd7a2b9-30fd-43d0-85c6-38a70773fb11 for instance 715a2f59-8055-4b6e-a32f-07a45609c931 on hv-cinder-80475 Aug 27 04:03:59.396558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-c0d8f950-c20b-4494-bbec-de771aef320c req-550faf0f-b79f-48fe-9b8f-0f0c4be78abb service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047340 Aug 27 04:03:59.397154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 73/130] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:03:59 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:03:59.421879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.432259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.433929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:03:59.435527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4eef7c19-41aa-4fa0-bb42-6cb7c1cce537 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.206011 Aug 27 04:03:59.436506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 58/131] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:03:59 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:03:59.956638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:03:59.957338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:03:59.971892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.972698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:03:59.974388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:03:59.974882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.230366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:00.231126 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:00.237252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:00.237697 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.238767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:00.239057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.248297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.257053 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1c795dd6-5a1e-4229-a0d2-e70eed36b94b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.304235 Aug 27 04:04:00.257607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 74/132] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:03:59 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:00.366179 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:00.367775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:00.375088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.377151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:00.377792 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.379162 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:00.380006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.383471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ec465575-7832-4f09-b4b6-3d2df88c1e60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.157004 Aug 27 04:04:00.385719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 59/133] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:00 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:00.460410 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:00.463091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:00.468549 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:00.469468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.470406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:00.470889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:00.570390 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.579866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8f68f553-ebd4-44f5-80ac-ba05a59821da tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.220284 Aug 27 04:04:00.585284 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 75/134] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:00 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:00.665904 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.678604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.680357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:00.681485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4295f0d8-094d-4012-8b08-3e1d9b19ce71 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.225670 Aug 27 04:04:00.686718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 60/135] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:00 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:04:01.274540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:01.275168 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:01.281334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.281813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.282618 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.283062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.405652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:01.406519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:01.415717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.416332 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.417705 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.418339 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.484949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.502317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0a6ecfff-1aca-4541-b71d-c049155a3858 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1318 microversion: 2.1 time: 0.227489 Aug 27 04:04:01.504831 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 76/136] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:01 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:01.510526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-fc39dc1f-5e0f-4d03-ac31-138862c9182f req-8670f35c-aeb5-48fa-8986-9fc3b4d83fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527b41-c9a1-4ffd-861a-e7ed1dcd796f", "name": "network-vif-plugged", "status": "completed", "tag": "8697a5a5-f72a-4cef-ae30-99ffc017de8e"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:01.512826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:04:01.512826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:04:01.525391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-fc39dc1f-5e0f-4d03-ac31-138862c9182f req-8670f35c-aeb5-48fa-8986-9fc3b4d83fa0 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.525820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-fc39dc1f-5e0f-4d03-ac31-138862c9182f req-8670f35c-aeb5-48fa-8986-9fc3b4d83fa0 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.547022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-fc39dc1f-5e0f-4d03-ac31-138862c9182f req-8670f35c-aeb5-48fa-8986-9fc3b4d83fa0 service nova] Creating event network-vif-plugged:8697a5a5-f72a-4cef-ae30-99ffc017de8e for instance fb527b41-c9a1-4ffd-861a-e7ed1dcd796f on hv-cinder-80475 Aug 27 04:04:01.553753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-fc39dc1f-5e0f-4d03-ac31-138862c9182f req-8670f35c-aeb5-48fa-8986-9fc3b4d83fa0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046617 Aug 27 04:04:01.554293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 77/137] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:04:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:01.581070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.589337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-00b781e6-792c-489e-b960-cf120a94639f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.191311 Aug 27 04:04:01.589917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 61/138] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:01 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:01.603646 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:01.604357 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:01.610961 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.611476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.612408 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.612815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.701175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:01.702297 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:01.710425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.715034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.716877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:01.717646 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:01.785482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.797221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-79f159ad-c13d-4df8-a760-58fd098de16c tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.198954 Aug 27 04:04:01.798436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 78/139] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:01 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:01.893535 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.903592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.910594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:01.912619 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e17803b8-0271-4423-bea7-f289921d8fcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.216104 Aug 27 04:04:01.913389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 62/140] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:01 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:04:02.522085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:02.527246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:02.534123 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.534658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.535977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.537243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.611933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:02.612554 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:02.623173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.624036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.625384 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.626356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.776955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:02.785987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-58c1bee1-c788-4dd8-9351-a9bab1477fde tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1509 microversion: 2.1 time: 0.268607 Aug 27 04:04:02.786679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 79/141] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:02 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:02.825430 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:02.825430 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:02.826598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.826979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.827910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.828974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.869521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:02.879595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3609f8c1-ebbd-4886-ba7f-5e76476110dd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.276105 Aug 27 04:04:02.891974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 63/142] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:02 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:02.932361 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:02.932979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:02.942086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.944284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:02.945111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:02.945554 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:03.026322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:03.034058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ce185083-fd6a-46a6-9a3f-68dda878ba70 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1314 microversion: 2.1 time: 0.222052 Aug 27 04:04:03.041334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 80/143] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:02 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:03.149391 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:03.158063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:03.159669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:03.161405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1fd5e69b-031c-46a9-b3b5-556cd2286012 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.232744 Aug 27 04:04:03.170365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 64/144] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:02 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:04:03.897898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:03.898619 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:03.904751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:03.905208 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:03.908317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:03.908317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:04.049645 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.057482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e526984e-0559-452c-9826-e462db16dc44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1321 microversion: 2.1 time: 0.163976 Aug 27 04:04:04.058068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 81/145] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:03 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:04.063703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:04.064817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:04.074833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:04.076001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:04.077315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:04.078052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:04.182225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:04.182798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:04.195184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:04.197817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:04.201207 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:04.201723 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:04.224702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.248381 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7de4235d-b2a6-4f1b-bc25-2c68ea5e946f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1500 microversion: 2.1 time: 0.190501 Aug 27 04:04:04.249133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 65/146] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:04 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1500 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:04.411268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.431408 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.433044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:04.434098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bb2a3408-41b7-4669-b70a-274aeeaf0e39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.257497 Aug 27 04:04:04.440779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 82/147] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:04 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:04:04.624811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-35d94dc9-ad76-4f70-83d3-48eeebb441ba req-1e7ad09e-1bc8-466e-b9c1-dc343c017d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "name": "network-vif-plugged", "status": "completed", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:04.626448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:04:04.626448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:04:04.642255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-35d94dc9-ad76-4f70-83d3-48eeebb441ba req-1e7ad09e-1bc8-466e-b9c1-dc343c017d9f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:04.642255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-35d94dc9-ad76-4f70-83d3-48eeebb441ba req-1e7ad09e-1bc8-466e-b9c1-dc343c017d9f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:04.646767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-35d94dc9-ad76-4f70-83d3-48eeebb441ba req-1e7ad09e-1bc8-466e-b9c1-dc343c017d9f service nova] Creating event network-vif-plugged:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:04:04.652545 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-35d94dc9-ad76-4f70-83d3-48eeebb441ba req-1e7ad09e-1bc8-466e-b9c1-dc343c017d9f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031003 Aug 27 04:04:04.653348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 66/148] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:04:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:05.081307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:05.082688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:05.089929 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.090385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.092359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.092359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.243175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.253247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2d0fd293-4f9e-40a3-9917-9b106c403c51 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1515 microversion: 2.1 time: 0.175664 Aug 27 04:04:05.265335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 83/149] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:05 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:05.273089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:05.277765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:05.279831 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.280284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.281124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.281666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.360962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lazy-loading 'flavor' on Instance uuid fb527b41-c9a1-4ffd-861a-e7ed1dcd796f {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:04:05.453534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:05.454166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:05.460960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.461414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.462199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.462671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.605642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.614138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.615974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.617131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e0f0ffe2-a2c7-4463-8fce-dc5b84e29ef7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.167553 Aug 27 04:04:05.617727 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 84/150] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:05 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:04:05.706955 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-484ecc6d-5de5-4552-bd55-19963c9e22b8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f/action" status: 200 len: 32 microversion: 2.1 time: 0.439822 Aug 27 04:04:05.707565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 67/151] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:04:05 2021] POST /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f/action => generated 32 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:04:05.717817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:05.718419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:05.724930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.725373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.726186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:05.726739 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:05.860859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:05.868739 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9c7527bc-038e-455b-8327-3010162d1850 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.154706 Aug 27 04:04:05.869439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 85/152] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:05 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:06.419686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9485df8a-ed07-4cd3-8f04-c8bde01eb333"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:06.420801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:06.427184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:06.427625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:06.428469 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:06.428902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:06.636183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:06.636902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:06.642815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:06.643352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:06.644197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:06.644704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:06.818539 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:06.827142 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:06.828673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:06.829784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e880906a-a5b3-4a47-bd76-f95ce9fb3250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1407 microversion: 2.20 time: 0.197856 Aug 27 04:04:06.830503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 86/153] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:06 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:04:06.888226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:06.888226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:06.894231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:06.894829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:06.896696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:06.897234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:07.048231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:07.056014 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bd98881b-7a1b-47c6-b7c1-f8b38887afda tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.173844 Aug 27 04:04:07.056629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 87/154] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:06 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:07.232002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "681f20e0-cb79-41dc-a4c6-c0542cdad4ea"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:07.233104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:07.239837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:07.240284 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:07.241060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:07.241662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:07.670175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d4eaecde-05e1-419c-b93a-17414bb4870b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254681 Aug 27 04:04:07.671091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 68/155] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:04:06 2021] POST /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 194 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:07.849728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:07.850629 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:07.857312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:07.857760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:07.858519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:07.859132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:08.016134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:08.018828 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:08.021344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:08.022476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c48ff75c-dd4a-4f53-a9e6-e278f8737253 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1598 microversion: 2.20 time: 0.177323 Aug 27 04:04:08.023243 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 69/156] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:04:07 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:04:08.049234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:08.049234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:08.049234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:08.049234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:08.053258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:08.053258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:08.139542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-89eb679a-3d84-4492-9c4d-e42257eefd13 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103204 Aug 27 04:04:08.140243 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 70/157] 10.222.0.73 () {60 vars in 1316 bytes} [Fri Aug 27 04:04:08 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:04:08.144556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:08.145187 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:08.152351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:08.152798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:08.153570 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:08.154006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:08.290939 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:08.298365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b5068922-c643-47fd-b2b0-c41696677919 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.157235 Aug 27 04:04:08.298956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 71/158] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:08 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:08.430597 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3dd17d9f-6f21-4ac5-8a3f-69d90fbd16d2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "POST /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.202262 Aug 27 04:04:08.431614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 88/159] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:04:07 2021] POST /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd/os-volume_attachments => generated 194 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:04:09.316413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:09.317273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:09.323914 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:09.324429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:09.325210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:09.325643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:09.466093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:09.474353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0b80cf50-af08-4b7d-87d1-4f27b9fa8c75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.161128 Aug 27 04:04:09.478670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 72/160] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:09 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:09.737311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:09.738364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:09.740578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-d46b3034-69f1-4d4a-9ade-71baf7fd0477 req-5b3fd9ac-235e-4f25-b8c4-a3d28cf3c713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:09.742265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:04:09.742265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:04:09.746061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:09.746542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:09.747347 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:09.747782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:09.749852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-d46b3034-69f1-4d4a-9ade-71baf7fd0477 req-5b3fd9ac-235e-4f25-b8c4-a3d28cf3c713 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:09.750295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-d46b3034-69f1-4d4a-9ade-71baf7fd0477 req-5b3fd9ac-235e-4f25-b8c4-a3d28cf3c713 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:09.762939 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-d46b3034-69f1-4d4a-9ade-71baf7fd0477 req-5b3fd9ac-235e-4f25-b8c4-a3d28cf3c713 service nova] Creating event network-changed:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:04:09.768601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-d46b3034-69f1-4d4a-9ade-71baf7fd0477 req-5b3fd9ac-235e-4f25-b8c4-a3d28cf3c713 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033010 Aug 27 04:04:09.769412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 73/161] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:04:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:10.492213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:10.493595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:10.499824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:10.500275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:10.501266 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:10.501854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:10.651674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:10.656259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3af78261-5913-4b80-bf0d-c3013be5fde7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.168707 Aug 27 04:04:10.657115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 74/162] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:10 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:11.673440 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:11.674231 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:11.681708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:11.682164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:11.682993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:11.683429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:11.811197 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:11.820166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d86db72e-9c04-45c4-8df9-73ce0d51963c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.150814 Aug 27 04:04:11.820852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 75/163] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:11 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:12.841060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:12.841679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:12.847556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:12.848004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:12.849579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:12.850119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:12.975552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:12.983308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8e3ead0f-3627-4268-9c08-cbe67e91d2a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.145652 Aug 27 04:04:12.994217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 76/164] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:12 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:13.526002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9aefe080-b70f-4735-8f03-26be4fc9eaa5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 3.795255 Aug 27 04:04:13.529527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 89/165] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:09 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 3800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:14.000634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:14.001905 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:14.009610 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:14.010089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:14.010971 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:14.011600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:14.253203 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:14.262811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4b965ab9-4941-4b78-97b9-4da4234f9960 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.265674 Aug 27 04:04:14.263318 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 77/166] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:13 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:14.538033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:14.543582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:14.548447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:14.549057 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:14.550357 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:14.550962 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:14.666468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0abcff15-1d63-46a4-9e86-3e631059d8af tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.132708 Aug 27 04:04:14.667328 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 90/167] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:14 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:15.279755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:15.281101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:15.288548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:15.289054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:15.289832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:15.290257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:15.468240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:15.476624 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9855be98-c037-49ae-b853-518298763b58 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.200735 Aug 27 04:04:15.477542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 78/168] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:15 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:15.682356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:15.683400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:15.690840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:15.691265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:15.693070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:15.693690 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:15.815990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d62ccd7a-7b16-4a99-a30b-982e147c19ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.141124 Aug 27 04:04:15.818247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 91/169] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:15 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:16.495288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:16.496504 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:16.502871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:16.511617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:16.511617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:16.511617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:16.644451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:16.653581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1b4b00eb-f037-4ad9-9206-c62c0dfd3070 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.162688 Aug 27 04:04:16.660625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 79/170] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:16 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:16.828559 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:16.829641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:16.836836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:16.837285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:16.838044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:16.838474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:16.977230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d9094aea-9cd5-4a1f-aacb-4ef307490609 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.152658 Aug 27 04:04:16.977773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 92/171] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:16 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:17.677057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:17.677694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:17.684792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:17.685246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:17.686043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:17.686474 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:17.839425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:17.847416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-48739faf-e7ef-4b72-870e-58d90a5e4201 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.174015 Aug 27 04:04:17.847992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 80/172] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:17 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:17.993573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:17.995190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:18.008960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:18.010731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:18.010894 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:18.011342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:18.146866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-21d5fa56-8f0c-4d8e-b011-a9c91be1d56b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.159816 Aug 27 04:04:18.151011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 93/173] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:17 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:18.866882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:18.867941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:18.878317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:18.879141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:18.880709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:18.881473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:19.014717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:19.024699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ead36406-1667-4fa7-ad49-466673ad2501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.163147 Aug 27 04:04:19.026723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 81/174] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:18 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:19.162586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:19.164256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:19.175125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:19.176406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:19.177608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:19.178423 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:19.309706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b3952306-77e8-4abf-9422-7b29274d4eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.154199 Aug 27 04:04:19.310336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 94/175] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:19 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:20.047576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:20.048237 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:20.055258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:20.055719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:20.056519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:20.057077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:20.229853 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:20.238037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e65d8b9a-2831-4ac0-91e4-35a70984eb70 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.194358 Aug 27 04:04:20.238635 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 82/176] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:20 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:20.321736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:20.322824 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:20.329642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:20.330077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:20.330880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:20.331305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:20.497058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-65c966d4-5094-48f5-9fb6-f19e75f77ab4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.179245 Aug 27 04:04:20.498445 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 95/177] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:20 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:21.262096 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:21.263600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:21.272617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:21.273081 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:21.274062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:21.274507 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:21.513699 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:21.515496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:21.526352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:21.527256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:21.528580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:21.529310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:21.560948 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:21.570960 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-48300778-0b96-4450-a03b-7dd99aa6e7fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.319521 Aug 27 04:04:21.571709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 83/178] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:21 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:21.657472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3e156b85-5f93-4261-8b68-b811ef870a3b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.150022 Aug 27 04:04:21.658111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 96/179] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:21 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:22.594312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:22.595156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:22.601276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:22.601722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:22.603046 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:22.603716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:22.675352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:22.685163 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:22.695836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:22.697828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:22.697828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:22.697828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:22.823373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:22.837621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-347c1b0c-f029-456d-8988-784ffeb5c60d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.246727 Aug 27 04:04:22.838274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 84/180] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:22 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:22.975838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5c289403-8e9e-4696-844a-7fc16fb7df3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.308542 Aug 27 04:04:22.980749 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 97/181] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:22 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:23.854450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:23.855239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:23.876269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:23.877188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:23.878910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:23.880538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:23.990337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:23.992249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:24.011174 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:24.011670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:24.012679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:24.013286 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:24.066219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:24.178372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3a6fdbeb-3d49-4fca-9571-6785aa1048f0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.225943 Aug 27 04:04:24.178372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 85/182] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:23 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:24.178949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d3af53eb-b5f1-4f6b-aef1-38ff1ce24e4a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14 microversion: 2.20 time: 0.160608 Aug 27 04:04:24.178949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 98/183] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:23 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:25.176780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:25.178080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:25.178953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1136935927", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "bd5cbeee-0483-497b-a816-2825652e56f8"}]}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:25.184696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:25.193180 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:25.193180 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:25.193180 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:25.263336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.network.neutron [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] validate_networks() for [('bd5cbeee-0483-497b-a816-2825652e56f8', None, None, None, None, None)] {{(pid=108986) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:04:25.291523 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-883a91db-7fd3-4fc9-b46e-00a01ab2090b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 7043 microversion: 2.20 time: 0.124193 Aug 27 04:04:25.296902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 86/184] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:25 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 7043 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:04:25.306287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:25.308266 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:25.319909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:25.320712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:25.322032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:25.322804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:25.560625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:25.576439 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1776227e-3ff8-4d66-a8b4-8f87024e3161 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.277723 Aug 27 04:04:25.580280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 87/185] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:25 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:25.884528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:04:25.884990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:04:25.885476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:04:25.885918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:04:25.886536 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:04:25.895853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:25.896309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:25.897115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:25.897553 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:25.919507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:04:25.923944 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for user a21ac4ce459d4eee9f73d4c7207968b4 and project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:04:25.935621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Going to run 1 instances... {{(pid=108986) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:04:25.938393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:04:26.150584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-20c6c38d-abd1-4d46-821c-197aa94f91b3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977912 Aug 27 04:04:26.151449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 99/186] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:04:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 980 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:04:26.161641 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c65d0ba8-bacf-45a5-a5ba-f4572e9a8295 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:26.162832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c65d0ba8-bacf-45a5-a5ba-f4572e9a8295 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:26.217693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c65d0ba8-bacf-45a5-a5ba-f4572e9a8295 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:26.224855 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c65d0ba8-bacf-45a5-a5ba-f4572e9a8295 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1218 microversion: 2.1 time: 0.067413 Aug 27 04:04:26.225424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 88/187] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:26 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:26.305798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:26.306893 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:26.329639 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:26.329639 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:26.330791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:26.331309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:26.463430 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-53963fae-b692-4275-8259-1f0a8d1178ce tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 14250 microversion: 2.20 time: 0.162633 Aug 27 04:04:26.464495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 100/188] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:26 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 14250 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:04:26.595105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:26.595981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:26.603169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:26.604564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:26.605499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:26.605937 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:26.779604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:26.779604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3e6e15ca-42e8-4c8f-912c-4b4c8dd7a15d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.188310 Aug 27 04:04:26.779604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 89/189] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:26 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:27.244161 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2174ef2c-a998-4939-b4c4-e7a229e2f12b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:27.245098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2174ef2c-a998-4939-b4c4-e7a229e2f12b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:27.302734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2174ef2c-a998-4939-b4c4-e7a229e2f12b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:27.310354 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2174ef2c-a998-4939-b4c4-e7a229e2f12b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1218 microversion: 2.1 time: 0.072369 Aug 27 04:04:27.311620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 101/190] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:27 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:27.475748 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:27.478186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:27.484489 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:27.485171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:27.485998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:27.486441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:27.600285 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-044e5600-9f99-40e5-92d4-457f8aca72f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 17984 microversion: 2.20 time: 0.128913 Aug 27 04:04:27.603928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 90/191] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:27 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 17984 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:27.795356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:27.796050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:27.803276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:27.803520 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:27.804485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:27.804956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:27.945610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:27.952828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b08c87c1-8d34-4750-bc9a-fb16c51a07bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.161506 Aug 27 04:04:27.953603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 102/192] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:27 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:28.331355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:28.332066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:28.339167 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:28.339696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:28.340539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:28.341034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:28.407186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:28.415320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d9b64503-5518-407b-aca8-938ef04203ea tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1270 microversion: 2.1 time: 0.089390 Aug 27 04:04:28.415893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 91/193] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:28 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:28.611535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:28.612449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:28.619356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:28.619941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:28.620903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:28.621337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:28.732788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-19da750f-572f-43dc-8eca-868f45e28816 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 18155 microversion: 2.20 time: 0.124816 Aug 27 04:04:28.733429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 103/194] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:28 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 18155 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:28.975133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:28.975133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:28.978252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:28.978958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:28.980151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:28.980379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:29.163519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:29.172521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-be10018d-559b-4aa0-ad3a-97edb3f236e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.205021 Aug 27 04:04:29.174526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 92/195] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:28 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:29.434298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:29.435060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:29.448598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:29.454030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:29.455565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:29.456175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:29.553710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:29.562829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-440a498a-62e9-4db3-981a-9649a28fd9da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1288 microversion: 2.1 time: 0.132360 Aug 27 04:04:29.564085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 104/196] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:29 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1288 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:29.748804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:29.748804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:29.753441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:29.754705 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:29.755899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:29.756491 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:29.897552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4f488049-db4c-4f64-9d6e-a0363897dcb4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 19722 microversion: 2.20 time: 0.156424 Aug 27 04:04:29.898201 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 93/197] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:29 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 19722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:30.200497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:30.201144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:30.207059 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:30.208760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:30.209567 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:30.210005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:30.435955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:30.444055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ee45ebe3-edab-485b-9438-fe717f9b46de tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.247329 Aug 27 04:04:30.444628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 105/198] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:30 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:30.586358 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:30.593927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:30.593927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:30.593927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:30.594987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:30.595278 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:30.869721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:30.877868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4ec3c720-07f9-4522-a522-c382429d0dff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.296712 Aug 27 04:04:30.878869 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 94/199] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:30 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:30.915823 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:30.917404 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:30.929213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:30.930019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:30.931490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:30.932281 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:31.073220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ff3fb903-fcfe-4a69-a42a-1879d4d5331c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 21338 microversion: 2.20 time: 0.164536 Aug 27 04:04:31.074020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 106/200] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:30 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 21338 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:31.464219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:31.464845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:31.471078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:31.471518 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:31.472288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:31.472718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:31.605524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-e5d1b7da-bb81-4704-bd47-60825d0e101a req-4d02342d-6700-4555-9a20-13237b7b327d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bdd098-dd03-464a-9fcb-b6def54ab684", "tag": "8e649769-14df-4b18-9356-5317f00eaeb7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:31.605524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:04:31.605524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:04:31.621879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-e5d1b7da-bb81-4704-bd47-60825d0e101a req-4d02342d-6700-4555-9a20-13237b7b327d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:31.622318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-e5d1b7da-bb81-4704-bd47-60825d0e101a req-4d02342d-6700-4555-9a20-13237b7b327d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:31.642371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-e5d1b7da-bb81-4704-bd47-60825d0e101a req-4d02342d-6700-4555-9a20-13237b7b327d service nova] Creating event network-changed:8e649769-14df-4b18-9356-5317f00eaeb7 for instance a8bdd098-dd03-464a-9fcb-b6def54ab684 on hv-cinder-80475 Aug 27 04:04:31.649233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-e5d1b7da-bb81-4704-bd47-60825d0e101a req-4d02342d-6700-4555-9a20-13237b7b327d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057724 Aug 27 04:04:31.650277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 107/201] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:04:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:04:31.683093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:31.695746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-098bc791-b90c-46e2-960f-cb20b8f95489 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.235209 Aug 27 04:04:31.696330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 95/202] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:31 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:31.901555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:31.902243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:31.909737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:31.911138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:31.912532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:31.912860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:32.049607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:32.058062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7e158c82-b069-4b29-a01f-26924f3c9745 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.160405 Aug 27 04:04:32.058670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 108/203] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:31 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:32.086210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:32.087124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:32.093261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:32.093706 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:32.094513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:32.094982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:32.714076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:32.714844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:32.721576 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:32.722022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:32.723007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:32.723300 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:32.848818 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:32.857062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e492679e-e0a8-430b-95f0-f13062588ce9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.146710 Aug 27 04:04:32.857626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 109/204] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:32 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:33.079631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:33.081079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:33.091957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:33.101009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:33.101009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:33.101009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:33.247036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:33.255244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-600b872e-1150-4eda-9e3f-58f56be62881 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.180802 Aug 27 04:04:33.255902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 110/205] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:33 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:33.874772 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:33.875500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:33.881491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:33.881939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:33.882754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:33.883195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:34.012177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:34.019548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c1d52263-7c64-49d8-b50c-11c8507cc58a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.148563 Aug 27 04:04:34.020658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 111/206] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:33 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:34.271929 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:34.272537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:34.278932 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:34.279260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:34.280110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:34.280554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:34.408165 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:34.416329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-29ae3b44-5cea-40a5-8530-904a8e8c9093 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.148689 Aug 27 04:04:34.416903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 112/207] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:34 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:35.036147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:35.036757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:35.043132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:35.043575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:35.044341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:35.044766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:35.181442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:35.189191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d0438a9b-c3f6-4039-8ef7-a983919dc0c9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.156677 Aug 27 04:04:35.189758 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 113/208] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:35 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:35.433340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:35.433941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:35.439869 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:35.440318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:35.441090 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:35.441536 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:35.569436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:35.576554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e22569ce-c5c9-42b2-a869-5e49ace778a8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.146848 Aug 27 04:04:35.577116 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 114/209] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:35 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:36.212473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:36.213292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:36.220706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:36.221295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:36.222084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:36.222527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:36.243580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-669f9c74-70dd-4898-82fd-aa714ff0a9de tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 25388 microversion: 2.20 time: 4.161805 Aug 27 04:04:36.247023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 96/210] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:32 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 25388 bytes in 4165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:36.436856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:36.444951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-28616cfc-987e-4b4d-9401-18a9bf20af65 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.238889 Aug 27 04:04:36.445706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 115/211] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:36 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:36.593615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:36.594313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:36.601818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:36.602273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:36.603088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:36.603519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:36.758019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:36.765261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-31701baf-e73f-401e-9c73-96091ef7fdec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.175641 Aug 27 04:04:36.765867 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 97/212] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:36 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:37.258814 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:37.259765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:37.272192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:37.273820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:37.273820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:37.274640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:37.462351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:37.462982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:37.468883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:37.469556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:37.470343 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:37.470805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:37.614382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:37.621789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-20afb4b6-d6e0-4a90-baa2-e636a6893a44 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.164366 Aug 27 04:04:37.622358 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 98/213] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:37 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:37.782433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:37.783223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:37.790813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:37.791284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:37.792054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:37.792485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:37.937093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:37.945238 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1f2087b3-8173-4a61-bae3-dfa5a4f78861 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.166492 Aug 27 04:04:37.945802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 99/214] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:37 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:38.394836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b11085ad-09d7-4571-9f04-92487bd5e044 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 27107 microversion: 2.20 time: 1.141045 Aug 27 04:04:38.395492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 116/215] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:37 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 27107 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:38.639459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:38.640105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:38.646817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:38.647273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:38.648060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:38.648496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:38.796644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:38.805313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f318986a-2c3b-41d3-9ae4-f1979e52871f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.169487 Aug 27 04:04:38.805891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 100/216] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:38 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:38.962500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:38.963323 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:38.969693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:38.970125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:38.970959 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:38.971392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.116680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:39.123888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ca0d9601-f1f2-454d-b21e-c017e7237665 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.165809 Aug 27 04:04:39.124450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 117/217] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:38 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:39.406543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:39.407471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:39.416340 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.416776 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.417729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.418324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.516680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:39.517269 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:39.523421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.526573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.526573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.526573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.550856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:04:39.579016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b10371df-2878-4383-b9d0-2fc24510b500 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 27616 microversion: 2.20 time: 0.175833 Aug 27 04:04:39.579793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 101/218] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:39 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 27616 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:39.825114 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:39.826426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:39.834886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.835447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.836306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.836799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.912625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a7fcda3d-0bea-4cac-b6af-81fc2bb1e049 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 204 len: 0 microversion: 2.1 time: 0.399052 Aug 27 04:04:39.916815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 118/219] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:04:39 2021] DELETE /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:04:39.922164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:39.922911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:39.929481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.929931 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:39.930741 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:39.931178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:40.018587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:40.027700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3c4eef35-a7de-4f4c-9347-4a4797bf974b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.209033 Aug 27 04:04:40.028283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 102/220] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:39 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:40.089701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:40.099506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4fca6ff9-7aff-410a-b29c-b19d666246e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.181303 Aug 27 04:04:40.100023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 119/221] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:39 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:40.140868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:40.141477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:40.148291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:40.148740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:40.149689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:40.149979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:40.308696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:40.319344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1cc7dd94-6994-4e62-b638-27064cc930be tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.182082 Aug 27 04:04:40.319928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 103/222] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:40 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:40.591210 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:40.592083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:40.598899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:40.599360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:40.600121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:40.600634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:40.780238 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8390285a-d52c-47cc-baf6-9852594a0144 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 27783 microversion: 2.20 time: 0.192101 Aug 27 04:04:40.781067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 120/223] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:40 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 27783 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:41.047323 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:41.048075 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:41.060682 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.061918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.064052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.064744 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.122060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:41.125234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:41.134867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.135622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.136498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.137006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.570934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:41.570934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ef713fb0-104c-4ae1-a890-4a96c836685d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.251877 Aug 27 04:04:41.570934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 104/224] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:41 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:41.570934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:41.571269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:41.571269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.571269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.571269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.571563 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.571645 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:41.571645 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b334552f-fdde-4f80-8e2a-7e59473b0a43 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.251857 Aug 27 04:04:41.571645 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 121/225] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:41 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:41.571878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:41.571878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6f5a6f9b-6bc9-4c1c-acc6-9f5e607b008a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.156489 Aug 27 04:04:41.571878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 105/226] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:41 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:41.792353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:41.794120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:41.800474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.801473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:41.802372 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:41.802904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:42.576546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:42.577146 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:42.583224 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:42.583717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:42.584497 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:42.584965 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:42.721554 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:42.729988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9df61eb5-6da9-4ab8-8096-53224a5afd90 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.157261 Aug 27 04:04:42.730578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 106/227] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:42 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:42.734893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:42.735487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:42.741934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:42.742386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:42.743185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:42.743620 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:42.871295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:42.879019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1fbc3f32-4524-45ce-963f-f64f1ffaff6c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.147427 Aug 27 04:04:42.879826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 107/228] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:42 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:42.883997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:42.884590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:42.890713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:42.891150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:42.891909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:42.892336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:43.028746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:43.037011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-38814b36-6d77-447a-8cef-f57f4450b57a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.156133 Aug 27 04:04:43.037595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 108/229] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:42 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:43.748358 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:43.749009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:43.755743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:43.763608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:43.763608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:43.763608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:43.895058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:43.903077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-223dc683-eee0-449a-8cf7-6d089db43aa6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.158617 Aug 27 04:04:43.906099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 109/230] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:43 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:43.908000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:43.908605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:43.915044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:43.915436 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:43.916216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:43.916737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:44.042012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:44.050393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-14b8478c-bd48-4d0f-b315-095e600ecb6f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.145240 Aug 27 04:04:44.051678 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 110/231] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:43 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:44.056112 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:44.060829 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:44.063315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:44.063939 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:44.064735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:44.065174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:44.210548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:44.218197 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f7cf2902-9635-445f-b919-39338ecd8fed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.165529 Aug 27 04:04:44.219001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 111/232] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:44 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:44.919795 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:44.920657 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:44.926885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:44.936640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:44.936640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:44.936640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:45.069721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:45.077986 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-32e26563-9b5f-41ce-9362-485b38ae346b tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.161888 Aug 27 04:04:45.078693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 112/233] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:44 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:45.083057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:45.083926 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:45.090196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:45.090689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:45.091472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:45.091904 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:45.225594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:45.235692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7676f4ac-0269-4fd9-b1a6-7b8e4afe7bc6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.156039 Aug 27 04:04:45.236261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 113/234] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:45 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:45.241211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:45.241805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:45.248308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:45.248759 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:45.249523 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:45.249951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:45.393434 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:45.401695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ce2b020d-8aa1-4a09-8432-1ca2231df978 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.164433 Aug 27 04:04:45.402859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 114/235] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:45 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:46.095006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:46.095673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:46.103079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:46.103533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:46.104432 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:46.104723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:46.230718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:46.238461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d4882c98-efb4-4274-bbd1-89982b75e036 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.147370 Aug 27 04:04:46.239219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 115/236] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:46 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:46.262517 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:46.263146 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:46.266830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9e7ad559-d098-4e87-a50a-9e2d25fbb2f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 27930 microversion: 2.20 time: 4.477692 Aug 27 04:04:46.268303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 122/237] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:41 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 27930 bytes in 4480 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:46.270361 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:46.270857 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:46.273347 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:46.273347 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:46.399723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:46.408485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b5f57f75-faf7-47bf-b61c-2a9c17299125 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.149497 Aug 27 04:04:46.409079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 116/238] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:46 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:46.422612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:46.423853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:46.431523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:46.431987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:46.432813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:46.433223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:46.570536 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:46.583481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-730f50a0-cac3-4642-bf17-1a45969b3bf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.164703 Aug 27 04:04:46.583689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 123/239] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:46 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:47.255921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:47.256706 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:47.262487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.262964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.263750 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.264182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.285052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:47.286788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:47.292654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.293160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.294058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.294493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.417963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:47.428952 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-26bf36ec-a8f6-4e46-927f-c1a937b71867 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.177149 Aug 27 04:04:47.429559 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 117/240] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:47 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:47.434227 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:47.434745 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:47.440697 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.441147 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.443277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.443735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.592582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:47.601683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-14b57bf1-afa7-4a71-b7b0-e3e39e7150f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.170982 Aug 27 04:04:47.604281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 118/241] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:47 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:47.606790 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:47.607454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:47.613352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.614712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.615517 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:47.615926 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:47.671341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-813c744f-1854-43c9-b128-497c1fd4ecbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 27990 microversion: 2.20 time: 0.390355 Aug 27 04:04:47.672854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 124/242] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:47 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 27990 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:04:47.780513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:47.793188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f772c359-753d-47d5-835d-b011ddc1e03a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.189826 Aug 27 04:04:47.793959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 119/243] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:47 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:48.446693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:48.447397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:48.453821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.454271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.455080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.455529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.581459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:48.589777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ca3459a6-1922-43bd-855c-0f665520944d tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.147295 Aug 27 04:04:48.590467 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 125/244] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:48 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:48.618994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:48.633123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:48.633123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.633123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.633123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.633848 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.689442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:48.691106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:48.698042 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.698580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.699989 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.700803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.814909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:48.826615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-25f4329f-5c76-4df7-b804-0855ca626f3d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.210697 Aug 27 04:04:48.827693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 120/245] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:48 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:48.833550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:48.834161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:48.841664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.842131 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.843043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:48.843572 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:48.956904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e28d6f5a-4c8f-4edd-8158-f543f0a77ba0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28109 microversion: 2.20 time: 0.271068 Aug 27 04:04:48.957745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 126/246] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:48 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28109 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:48.990366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:48.998324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e3f5a6b1-f154-4cba-b5b7-57d9545ebff7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.169039 Aug 27 04:04:48.998943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 121/247] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:48 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:49.608190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:49.608874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:49.616350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:49.616789 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:49.617558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:49.618056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:49.785447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:49.785447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-69918995-1c41-4276-8888-e06096e9ed06 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.180263 Aug 27 04:04:49.785447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 127/248] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:49 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:49.845322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:49.846111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:49.859492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:49.859492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:49.859492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:49.859492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:49.969293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:49.970213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:49.976950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:49.977402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:49.978194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:49.978743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:50.027040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:50.034633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1744cebe-2113-425b-a54b-c7014cac259f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.193310 Aug 27 04:04:50.035265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 122/249] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:49 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:50.040280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:50.040889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:50.047662 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:50.048350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:50.049282 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:50.049712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:50.112122 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e07ac660-4e06-455a-8912-28f9873ffb4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.146298 Aug 27 04:04:50.113113 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 128/250] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:49 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:04:50.202013 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:50.216881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-03037231-0b10-4e43-bacc-82808daa639d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.180001 Aug 27 04:04:50.217791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 123/251] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:50 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:50.698781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-2b49dead-5581-404a-bf53-4e4ca40d96cf req-0927f2a8-6f2c-49a0-b539-30ba55b5d25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bdd098-dd03-464a-9fcb-b6def54ab684", "name": "network-vif-plugged", "status": "completed", "tag": "8e649769-14df-4b18-9356-5317f00eaeb7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:50.701475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:04:50.701475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:04:50.711914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-2b49dead-5581-404a-bf53-4e4ca40d96cf req-0927f2a8-6f2c-49a0-b539-30ba55b5d25f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:50.712386 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-2b49dead-5581-404a-bf53-4e4ca40d96cf req-0927f2a8-6f2c-49a0-b539-30ba55b5d25f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:50.723542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-2b49dead-5581-404a-bf53-4e4ca40d96cf req-0927f2a8-6f2c-49a0-b539-30ba55b5d25f service nova] Creating event network-vif-plugged:8e649769-14df-4b18-9356-5317f00eaeb7 for instance a8bdd098-dd03-464a-9fcb-b6def54ab684 on hv-cinder-80475 Aug 27 04:04:50.728336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-2b49dead-5581-404a-bf53-4e4ca40d96cf req-0927f2a8-6f2c-49a0-b539-30ba55b5d25f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036675 Aug 27 04:04:50.728925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 129/252] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:04:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:50.802430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:50.803082 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:50.809248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:50.809700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:50.810480 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:50.810942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:50.941215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:50.951067 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-04b19487-2f5d-421a-b644-36929f4c8b71 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.153046 Aug 27 04:04:50.951651 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 124/253] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:50 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:51.057052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:51.057690 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:51.063828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.064279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.065046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.065486 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.129477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:51.130597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:51.137449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.137807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.138603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.139036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.229551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8e953464-74c6-40ec-b093-d4f01d716b35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.103579 Aug 27 04:04:51.230207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 125/254] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:51 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:04:51.238036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:51.243901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:51.244590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:51.247656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6c8fc44e-db4a-465a-be4d-a79e14d956ef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.194686 Aug 27 04:04:51.248212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 130/255] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:51 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:51.251261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.251703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.252474 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.252902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.392710 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:51.403166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-91155a30-e7af-4eaf-8c4a-fbb49ec147f2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.163154 Aug 27 04:04:51.403669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 126/256] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:51 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:51.969112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:51.969734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:51.976848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.977295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:51.978080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:51.978517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.107612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:52.115198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-68d0143b-8319-4d1d-98a3-1d3d2de414b2 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.149862 Aug 27 04:04:52.117049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 131/257] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:51 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:52.243612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:52.244041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:52.250424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.250906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.251677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.252116 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.265165 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:52.266089 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:52.272696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.273252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.273965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.274403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.355615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ffac2e3a-0270-4f6a-9ebe-6cd69116660b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.116025 Aug 27 04:04:52.357136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 127/258] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:52 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:52.439354 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:52.440215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:52.448356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.448842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.450086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.450550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.669071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:52.679077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:52.688327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-470bfc76-79af-4c6f-b11f-b662e79a7a92 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.426900 Aug 27 04:04:52.688918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 132/259] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:52 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:52.691451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-205c8714-2102-4e8e-b0e5-7892a704c555 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1318 microversion: 2.1 time: 0.269280 Aug 27 04:04:52.693045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 128/260] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:52 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1318 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:52.744765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-f37df24f-7333-4beb-ae9f-fd8efd695afe req-f93782ec-92fc-4b61-882c-5ac50529c71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3023b951-fa8f-4235-ac32-1423097b35cd", "name": "network-vif-unplugged", "status": "completed", "tag": "8d437acd-33d0-47b8-9d2f-3680430a75b6"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:52.746310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:04:52.746310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:04:52.753055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-f37df24f-7333-4beb-ae9f-fd8efd695afe req-f93782ec-92fc-4b61-882c-5ac50529c71c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:52.753495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-f37df24f-7333-4beb-ae9f-fd8efd695afe req-f93782ec-92fc-4b61-882c-5ac50529c71c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:52.766371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-f37df24f-7333-4beb-ae9f-fd8efd695afe req-f93782ec-92fc-4b61-882c-5ac50529c71c service nova] Creating event network-vif-unplugged:8d437acd-33d0-47b8-9d2f-3680430a75b6 for instance 3023b951-fa8f-4235-ac32-1423097b35cd on hv-cinder-80475 Aug 27 04:04:52.771384 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-f37df24f-7333-4beb-ae9f-fd8efd695afe req-f93782ec-92fc-4b61-882c-5ac50529c71c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030287 Aug 27 04:04:52.771979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 133/261] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:04:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:53.132110 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:53.132626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:53.138736 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.139184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.143596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.143596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.267771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:53.277175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-68315947-761c-4538-8cb3-5b60a00870d4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.149022 Aug 27 04:04:53.277872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 129/262] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:53 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:53.369033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:53.370027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:53.376138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.376587 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.377359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.377824 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.479973 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d1783535-2b99-4282-9c7d-21abc42465e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.113977 Aug 27 04:04:53.480390 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 134/263] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:53 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:53.706883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:53.708060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:53.712460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:53.713318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:53.715119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.715522 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.716305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.716743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.721513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.721987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.722803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.723231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.903910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:53.908566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:53.911519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2bc1b69d-8a6a-4678-a739-8ac49e6994a6 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.208323 Aug 27 04:04:53.912089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 130/264] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:53 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:53.915981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-55d8ea1e-1402-4bde-9204-ea97721defb8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1508 microversion: 2.1 time: 0.208460 Aug 27 04:04:53.916539 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 135/265] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:53 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:53.932976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9485df8a-ed07-4cd3-8f04-c8bde01eb333"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:53.934060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:53.939887 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.940329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:53.941097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:53.942297 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.028576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] HTTP exception thrown: Invalid volume: volume 9485df8a-ed07-4cd3-8f04-c8bde01eb333 is already attached to instances: 664ae18c-f051-4b0e-a20b-d77df52d1a1a Aug 27 04:04:54.029260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Returning 400 to user: Invalid volume: volume 9485df8a-ed07-4cd3-8f04-c8bde01eb333 is already attached to instances: 664ae18c-f051-4b0e-a20b-d77df52d1a1a {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:04:54.030105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-086686e0-499d-4b7e-9831-c17d8440f7ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101002 Aug 27 04:04:54.030664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 131/266] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:04:53 2021] POST /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:04:54.094799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:54.095297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:54.102021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.102472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.103293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.103735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.231895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'services' on Instance uuid 664ae18c-f051-4b0e-a20b-d77df52d1a1a {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:04:54.294976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:54.296122 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:54.304076 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.304538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.305330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.305765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.430459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:54.438356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2fd56fd5-990a-4bdb-a74e-3c4b3ad339e9 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.147164 Aug 27 04:04:54.438956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 132/267] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:54 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:54.491134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:54.492164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:54.498062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.498514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.499322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.499762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.517661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f4c29058-e53a-4a61-92f1-c366d0a98e89 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments/9485df8a-ed07-4cd3-8f04-c8bde01eb333" status: 202 len: 0 microversion: 2.1 time: 0.426367 Aug 27 04:04:54.532388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 136/268] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:04:54 2021] DELETE /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments/9485df8a-ed07-4cd3-8f04-c8bde01eb333 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:54.538326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:54.539395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:54.546234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.546756 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.547544 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.547977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.578666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a4547d66-0c6f-49d1-9570-fa2efc4585c3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 27 04:04:54.579231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 137/269] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:04:54 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:54.590381 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e264b158-d7ce-41da-a24f-a8967e894200 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.103430 Aug 27 04:04:54.591306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 133/270] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:54 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:04:54.929678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:54.930738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:54.937578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.938037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:54.938860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:54.939293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.064905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:55.073492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7d189ccd-a707-49a6-8a39-4dcbcb5a1529 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.148377 Aug 27 04:04:55.074067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 138/271] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:54 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:55.457068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:55.458077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:55.464403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:55.464846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.465603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:55.466031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.592827 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:55.593798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:55.595062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:55.600571 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:55.601015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.601972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:55.602435 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.604732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3415cd9f-e873-46da-bd47-b3102be003ff tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.151759 Aug 27 04:04:55.605384 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 134/272] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:55 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:55.609983 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:55.610997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:55.617244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:55.617691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.618465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:55.619169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:55.641102 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-efde6894-56ac-427a-98b2-669bb86d2608 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053315 Aug 27 04:04:55.641663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 139/273] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:04:55 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:55.725348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d188bafd-23d1-4b90-952d-1f09959949ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.118648 Aug 27 04:04:55.725996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 135/274] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:55 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:56.090947 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:56.091555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:56.097431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.099130 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.100072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.100515 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.221128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:56.228982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8b2cc33a-d5f4-428a-b67d-e483705b8148 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1521 microversion: 2.1 time: 0.141726 Aug 27 04:04:56.229576 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 140/275] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:56 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:56.625433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:56.626208 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:56.633011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.633472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.634254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.636886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.657432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:56.660016 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:56.685069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.685846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.686930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.687898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.733927 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-709a4997-acb8-4ac3-b186-4c7d3911fbb0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084417 Aug 27 04:04:56.734621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 141/276] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:04:56 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:56.739373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:56.740341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:56.746808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.747324 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.750820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:56.750820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:56.777867 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:56.785988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6a6f0af9-9c86-459b-bfed-6733a1a87484 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.164468 Aug 27 04:04:56.786755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 136/277] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:56 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:56.842466 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f54b1444-5788-4dc1-9658-d0e21701be3d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.106437 Aug 27 04:04:56.843124 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 142/278] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:56 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:04:57.245525 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.246035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:57.252027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.252476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.253257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.253684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.385395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:57.392745 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dcaf1241-3934-4adf-9bfc-ebaf80620c48 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1501 microversion: 2.1 time: 0.150959 Aug 27 04:04:57.393308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 137/279] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:57 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:57.409616 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.410892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:57.417641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.418076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.418942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.419313 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.547247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:57.555810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b8786b7b-5d98-4868-9eb5-024a372a60db tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1515 microversion: 2.1 time: 0.150189 Aug 27 04:04:57.556398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 143/280] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:57 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:57.754123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.754123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:57.759427 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.760451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.760656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.761033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.798730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aefddbb1-b626-4b57-aa3d-347c2b1cc6c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054907 Aug 27 04:04:57.799286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 138/281] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:04:57 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:57.802952 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:57.803566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:57.809459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.809904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.810698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.811132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.854254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:57.855217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:57.866634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.867441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.868833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:57.869689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:57.963448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:57.971252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a6892d33-a21f-41e5-bd93-0e1dcccb42f4 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.172074 Aug 27 04:04:57.971941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 144/282] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:57 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:04:57.978324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-162ad80a-c055-4d1a-913a-0073f6de0a2c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.127468 Aug 27 04:04:57.978983 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 139/283] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:57 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:04:58.809333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:58.810376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:58.817416 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:58.818177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:58.818586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:58.819052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:58.848734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1e08650e-e57e-4832-a26b-f03892f37a63 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 Aug 27 04:04:58.849273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 145/284] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:04:58 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:04:58.991394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:04:58.992625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:58.996810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:58.997925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:58.999569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:59.000020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:59.000815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:59.001652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:59.004873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:59.005340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:59.006163 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:59.006630 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:59.131289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:04:59.139315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cf927182-c150-4245-8724-832e93af5b32 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.146277 Aug 27 04:04:59.139882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 146/285] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:04:58 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:04:59.860381 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:04:59.861409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:04:59.868011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:59.868521 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:59.869724 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:04:59.870435 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:04:59.906024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-094f737c-eb33-44da-8776-32db8e7ae5f8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049418 Aug 27 04:04:59.906679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 147/286] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:04:59 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:00.157166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:00.158006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:00.164097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:00.164550 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:00.165340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:00.165779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:00.295850 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:00.305086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-97be605f-c916-4cb0-af23-3781ef64fd22 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.152814 Aug 27 04:05:00.305921 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 148/287] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:00 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:00.917694 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:00.918900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:00.926303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:00.926927 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:00.927867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:00.928366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:00.958504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d9b93c02-1462-45d2-b351-6ac90b5129d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044690 Aug 27 04:05:00.959120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 149/288] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:00 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:01.324613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:01.325246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:01.332817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:01.333665 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:01.334680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:01.335202 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:01.487104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:01.495884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-33aaeeea-cebd-44df-af78-4e6b0f6b3e18 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.176917 Aug 27 04:05:01.496459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 150/289] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:01 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:01.969843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:01.970808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:01.977679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:01.978653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:01.979046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:01.979647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:02.020743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f05ccc28-3660-4388-a4b2-d8b61c5de814 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053248 Aug 27 04:05:02.021937 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 151/290] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:01 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:02.512418 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:02.513029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:02.519228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:02.520266 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:02.521044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:02.521480 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:02.593128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aef2ec34-5e3f-4705-8fda-484a932dd2e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 3.606309 Aug 27 04:05:02.594144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 140/291] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:04:58 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 3608 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:02.661005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:02.669708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0982679f-c0e8-4ac6-bb51-478eb51f8528 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1552 microversion: 2.1 time: 0.160912 Aug 27 04:05:02.670289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 152/292] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:02 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:03.040271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:03.042144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:03.050252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.051800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.052090 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.052698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.091727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fb602c84-c08d-4413-bef7-8d9309115419 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057818 Aug 27 04:05:03.092757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 141/293] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:03 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:03.540711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-6db710a7-5aa9-4322-bfde-db64ccf52669 req-5c0b9782-ec07-4a58-bec7-dfc5bd4984f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3023b951-fa8f-4235-ac32-1423097b35cd", "name": "network-vif-deleted", "tag": "8d437acd-33d0-47b8-9d2f-3680430a75b6"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:03.542545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:05:03.542545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:05:03.550666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-6db710a7-5aa9-4322-bfde-db64ccf52669 req-5c0b9782-ec07-4a58-bec7-dfc5bd4984f0 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.551137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-6db710a7-5aa9-4322-bfde-db64ccf52669 req-5c0b9782-ec07-4a58-bec7-dfc5bd4984f0 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.567220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-6db710a7-5aa9-4322-bfde-db64ccf52669 req-5c0b9782-ec07-4a58-bec7-dfc5bd4984f0 service nova] Creating event network-vif-deleted:8d437acd-33d0-47b8-9d2f-3680430a75b6 for instance 3023b951-fa8f-4235-ac32-1423097b35cd on hv-cinder-80475 Aug 27 04:05:03.575558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-6db710a7-5aa9-4322-bfde-db64ccf52669 req-5c0b9782-ec07-4a58-bec7-dfc5bd4984f0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045432 Aug 27 04:05:03.580075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 153/294] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:05:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:03.614293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:03.615807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:03.623625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.626433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.626433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.626433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.689381 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:03.690001 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:03.697019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.697813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.698636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:03.699068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:03.747263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e700471d-5b1c-4e41-87e9-bba5d55b4c01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.139573 Aug 27 04:05:03.748043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 142/295] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:03 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:03.764009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:03.773062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c2d21655-6bd7-4d6f-9547-e2e0c6bd8b9f tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1510 microversion: 2.1 time: 0.088515 Aug 27 04:05:03.773632 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 154/296] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:03 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1510 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:04.105214 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:04.106198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:04.116967 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.117488 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.118295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.118774 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.153176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3c6b3ecc-a832-4407-816a-8803294c407c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052000 Aug 27 04:05:04.153747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 143/297] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:04 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:04.188920 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:04.189947 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:04.197277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.201903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.201903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.201903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.241898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lazy-loading 'flavor' on Instance uuid 715a2f59-8055-4b6e-a32f-07a45609c931 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:05:04.739904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-98fd5f8d-9026-4ecc-9b87-7d6e86e270a8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action" status: 200 len: 32 microversion: 2.1 time: 0.555223 Aug 27 04:05:04.740856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 155/298] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:05:04 2021] POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action => generated 32 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:05:04.751986 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:04.752921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:04.761781 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.761781 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.762707 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.763147 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.766524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:04.767579 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:04.781988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.781988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.783518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.783518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.946409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:04.953928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-25affb56-dd36-4751-9b41-99aea2fb67f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.208018 Aug 27 04:05:04.964325 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 144/299] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:04 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:04.969047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:04.969653 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:04.975944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.976397 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:04.977483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:04.977583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:05.058077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:05.068761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-13269ea9-6fa6-43ee-8007-88b97fcb8a2a tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1345 microversion: 2.1 time: 0.103239 Aug 27 04:05:05.069729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 145/300] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:04 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:05.164689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:05.168582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:05.172852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:05.173302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:05.174114 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:05.174550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:05.204574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d5a29463-dff5-4c8b-ab2d-2bc1dcd5e196 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043511 Aug 27 04:05:05.205438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 146/301] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:05 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:05:05.393357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1639151598", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "bd5cbeee-0483-497b-a816-2825652e56f8"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:05.447057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] validate_networks() for [('bd5cbeee-0483-497b-a816-2825652e56f8', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:05:05.909259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:05:05.911356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:05:05.911356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:05:05.911356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:05:05.911755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:05:05.920490 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:05.921306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:05.922059 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:05.922493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:05.941493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:05:05.947205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for user a21ac4ce459d4eee9f73d4c7207968b4 and project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:05:05.962744 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:05:05.968690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:05:06.118826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ed85a81d-1656-4473-a053-f40b8c742e1e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728799 Aug 27 04:05:06.119369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 147/302] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:05:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:05:06.126286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:06.126286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:06.132168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:06.132758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:06.133641 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:06.134171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:06.301433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:06.308767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-86ef1234-774b-40cf-add2-1767699fa78d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.188406 Aug 27 04:05:06.309328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 148/303] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:06 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:06.313572 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:06.314167 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:06.321374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:06.321818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:06.322638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:06.323064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:06.388382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:06.396422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-19c1b564-ef44-486a-85c6-cf72988b6004 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1345 microversion: 2.1 time: 0.086124 Aug 27 04:05:06.396994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 149/304] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:06 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1345 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:06.401200 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6cc68ddd-390a-46af-9c24-42e792759adb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:06.401917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6cc68ddd-390a-46af-9c24-42e792759adb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:06.460020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6cc68ddd-390a-46af-9c24-42e792759adb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:06.467265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6cc68ddd-390a-46af-9c24-42e792759adb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1218 microversion: 2.1 time: 0.069301 Aug 27 04:05:06.467834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 150/305] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:06 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:07.327522 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:07.328403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:07.335275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.335825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.336723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.345605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.609284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:07.618080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d1fd2142-fdab-4ff8-8d5e-089c3c395cfb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.294372 Aug 27 04:05:07.618862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 151/306] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:07 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:07.625310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:07.626446 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:07.637246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.637803 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.638904 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.639341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.669617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.670054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.670497 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lazy-loading 'fault' on Instance uuid 3023b951-fa8f-4235-ac32-1423097b35cd {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:05:07.716136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:07.724326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e2307c81-bfad-4afd-b6df-481e0ef59f54 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1350 microversion: 2.1 time: 0.104338 Aug 27 04:05:07.724326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 152/307] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:07 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:07.729486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:07.730241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:07.739374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.739824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.743695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:07.743695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:07.806734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:07.820328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a58fee9f-8ecd-4d6d-9629-78aa6a8cc096 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1222 microversion: 2.1 time: 0.094086 Aug 27 04:05:07.821273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 153/308] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:07 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:08.635613 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:08.636331 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:08.642370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.642860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:08.643660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.644099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:08.778263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:08.787084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ebb78639-7279-4bd7-a00e-ed0dfcf0801b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.155379 Aug 27 04:05:08.787658 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 154/309] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:08 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:08.792092 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:08.792611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:08.798708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.799166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:08.799946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.800386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:08.858698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.859260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:08.859739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lazy-loading 'fault' on Instance uuid 3023b951-fa8f-4235-ac32-1423097b35cd {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:05:08.914574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:08.924640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0b9b68c7-87b6-4f88-959a-b09ba7d1e9ed tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1350 microversion: 2.1 time: 0.135908 Aug 27 04:05:08.934594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 155/310] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:08 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:08.934594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:08.934594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:08.940571 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.943903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:08.943903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:08.943903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:09.013746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:09.033450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dd40bd89-f8c6-4969-96f5-c32dceb18725 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1222 microversion: 2.1 time: 0.105262 Aug 27 04:05:09.034398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 156/311] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:08 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:09.175907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b650db51-a745-4504-8ae3-10720ca89fdb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 4.414593 Aug 27 04:05:09.177078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 156/312] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:04 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 4417 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:09.805575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:09.806293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:09.812357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:09.812818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:09.813596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:09.814315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:09.951860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:09.953142 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:09.957998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:09.962412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:09.963069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:09.963866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:09.964620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:09.970274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8a148be8-73e5-4476-8532-081241a3a670 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.164809 Aug 27 04:05:09.970274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 157/313] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:09 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:10.002335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:10.003118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:10.004463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lazy-loading 'fault' on Instance uuid 3023b951-fa8f-4235-ac32-1423097b35cd {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:05:10.056885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:10.058204 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:10.069051 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:10.069886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:10.072033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:10.072938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:10.103117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3383e658085a4ae1ae783bc3e90e42b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2a4f9dd7d714d20afb13bd273d14061', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:10.118763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c785010c-09e7-420d-87a5-07c8bf89b0e3 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 200 len: 1350 microversion: 2.1 time: 0.174752 Aug 27 04:05:10.119350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 157/314] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:09 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 1350 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:10.155476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:10.163929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-410853db-2ba0-4d25-ae23-8e3409b7075d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1214 microversion: 2.1 time: 0.114609 Aug 27 04:05:10.164530 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 158/315] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:10 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:10.188725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:10.190266 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:10.196850 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:10.197306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:10.198115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:10.198534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:10.317836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b848b114-ad53-46d3-9a2d-894b81f540c7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.130788 Aug 27 04:05:10.319610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 158/316] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:10 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:10.985946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:10.986606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:10.998656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:10.999309 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.000265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.000846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.136151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:11.136729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:11.144840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.145291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.146262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.147348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.161287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] HTTP exception thrown: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. Aug 27 04:05:11.161884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Returning 404 to user: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:05:11.162749 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-34834be1-7050-46ca-902a-bf869136b147 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 404 len: 111 microversion: 2.1 time: 0.030922 Aug 27 04:05:11.163308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 159/317] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:11 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:05:11.189630 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:11.192476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:11.205804 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.206497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.208392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.208895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.268583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:11.279136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bd7ede6f-02af-47fb-8078-b8fbadc2f001 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.297003 Aug 27 04:05:11.301553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 159/318] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:10 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:11.306693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:11.307683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:11.314667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.315440 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.316471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.317319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.338026 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] HTTP exception thrown: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. Aug 27 04:05:11.338942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Returning 404 to user: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:05:11.340049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3f13825f-dd94-4abb-88d7-8e8005594da6 tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037354 Aug 27 04:05:11.344493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 160/319] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:11 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd/os-volume_attachments => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:05:11.351506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:11.354160 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:11.367924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.375433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.375433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:11.375433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:11.393972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:11.402672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6a1bab7c-4c0a-4ef4-a446-825d04e80511 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1278 microversion: 2.1 time: 0.222505 Aug 27 04:05:11.403549 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 160/320] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:11 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:11.499068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f522499b-32d7-4a25-a6ce-aa67f040986e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.152899 Aug 27 04:05:11.499859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 161/321] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:11 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:12.299622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:12.300216 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:12.306908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:12.307353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:12.308125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:12.308596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:12.430574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:12.431410 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:12.439296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:12.439968 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:12.440942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:12.442412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:12.631287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:12.631287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b37e4757-c386-4725-a80d-26dd5cd1ad47 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.286666 Aug 27 04:05:12.631287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 161/322] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:12 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:12.631287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:12.632098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:12.632098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:12.632098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:12.632098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:12.632471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:12.637493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:12.645621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-76c344e3-71f1-451d-9ede-cc747907d125 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.221266 Aug 27 04:05:12.646335 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 162/323] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:12 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:12.747052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6f9d8364-d5d5-4923-84c6-6181f9413aae tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.161215 Aug 27 04:05:12.752722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 162/324] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:12 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:13.647816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:13.648526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:13.654995 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:13.655455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:13.656228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:13.656662 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:13.701322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:13.704325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:13.708734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:13.709239 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:13.710037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:13.710873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:13.910592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:13.927352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ab9b0adc-68aa-4ebe-9e33-44eda459c340 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.284053 Aug 27 04:05:13.931165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 163/325] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:13 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:13.938006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:13.939518 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:13.952804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:13.954231 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:13.957263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:13.960253 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:13.993809 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:14.005293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9a7652ec-a678-4fdd-9f53-7f2d231d4080 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.308064 Aug 27 04:05:14.005882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 163/326] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:13 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:14.010937 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-671a7648-35b5-48c9-8d8f-8ebe10222a30 req-81455e28-df46-4d94-a180-b12686ac8d4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8372e50f-df43-4829-b2c7-7d1a9334f817", "tag": "e27b77a5-6aea-4f02-b303-64570873e3a4"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:14.013775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:05:14.013775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:05:14.022452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-671a7648-35b5-48c9-8d8f-8ebe10222a30 req-81455e28-df46-4d94-a180-b12686ac8d4f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.022930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-671a7648-35b5-48c9-8d8f-8ebe10222a30 req-81455e28-df46-4d94-a180-b12686ac8d4f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:14.035912 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-671a7648-35b5-48c9-8d8f-8ebe10222a30 req-81455e28-df46-4d94-a180-b12686ac8d4f service nova] Creating event network-changed:e27b77a5-6aea-4f02-b303-64570873e3a4 for instance 8372e50f-df43-4829-b2c7-7d1a9334f817 on hv-cinder-80475 Aug 27 04:05:14.042867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-671a7648-35b5-48c9-8d8f-8ebe10222a30 req-81455e28-df46-4d94-a180-b12686ac8d4f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035253 Aug 27 04:05:14.043528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 164/327] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:05:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:14.048975 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:14.049569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:14.057174 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.057627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:14.058483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.058943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:14.074941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] HTTP exception thrown: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. Aug 27 04:05:14.075545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Returning 404 to user: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:05:14.076397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-61bf4a5f-aea9-4c9e-932e-9afb21d1ad8e tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "DELETE /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 404 len: 111 microversion: 2.1 time: 0.031733 Aug 27 04:05:14.077079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 165/328] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:05:14 2021] DELETE /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:05:14.086695 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:14.087647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] [instance: 3023b951-fa8f-4235-ac32-1423097b35cd] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:14.094054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.094636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:14.095530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.096063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:14.108865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e275ccea-7cdb-44b2-a797-bcdec81729eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.178127 Aug 27 04:05:14.112970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] HTTP exception thrown: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. Aug 27 04:05:14.114591 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] Returning 404 to user: Instance 3023b951-fa8f-4235-ac32-1423097b35cd could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:05:14.114732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 164/329] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:13 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:14.115764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-50874ff0-9f92-4d2b-88b6-bfebdb09d2cb tempest-DeleteServersTestJSON-1286559190 tempest-DeleteServersTestJSON-1286559190-project] 10.222.0.73 "GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd" status: 404 len: 111 microversion: 2.1 time: 0.033202 Aug 27 04:05:14.116646 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 166/330] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:14 2021] GET /compute/v2.1/servers/3023b951-fa8f-4235-ac32-1423097b35cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:05:14.956239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:14.958661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:14.968141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.969378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:14.971052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:14.971784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:15.030087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:15.030746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:15.038736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:15.039391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:15.042967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:15.043428 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:15.333850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:15.347159 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-34d21225-dcd4-4565-9618-a41214e6bbb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.402863 Aug 27 04:05:15.360723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 165/331] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:14 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:15.365120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:15.371579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:15.376483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:15.377311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a613366e-2dce-4347-aa8c-513777f05663 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.351126 Aug 27 04:05:15.378503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 167/332] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:15 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:15.393448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:15.393934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:15.395635 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:15.396024 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:15.513681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-45adbc24-cdae-4435-b15d-4f588c065a2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.150933 Aug 27 04:05:15.518194 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 166/333] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:15 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:16.372358 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:16.373714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:16.380712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:16.382891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:16.382891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:16.382891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:16.401928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:16.403316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:16.414119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:16.415756 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:16.417052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:16.418947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:16.563089 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:16.573352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a3099fc7-9d41-4b5e-b4fd-5dfafcfa2451 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.207668 Aug 27 04:05:16.574170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 168/334] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:16 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:16.602587 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:16.602587 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:16.602587 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:16.602587 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:16.603160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:16.603160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:16.635513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:16.648834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0fac9bce-ce6d-4a5d-9f80-8a20543ef011 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.250348 Aug 27 04:05:16.654035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 167/335] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:16 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:16.734914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5d12aa54-4ad0-4a5a-a3de-1d806046c585 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.143954 Aug 27 04:05:16.734914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 169/336] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:16 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:17.592481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:17.593981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:17.602685 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:17.603447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:17.604766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:17.605464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:17.662588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:17.663311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:17.681844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:17.682298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:17.683111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:17.683541 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:17.812667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:17.830233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4e542f56-d70b-4620-a1af-4e8e3f680f22 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.242709 Aug 27 04:05:17.830873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 168/337] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:17 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:17.837564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:17.839630 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:17.848050 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:17.848899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:17.857816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:17.857816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:17.864526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:17.873973 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3fadb5c1-5e9a-47f1-9f5d-9028034be865 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.216311 Aug 27 04:05:17.874734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 170/338] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:17 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:17.954871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7fc3054d-6a6e-4333-8119-4d98bd070647 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.122410 Aug 27 04:05:17.955516 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 169/339] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:17 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:18.855034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:18.855881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:18.863212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:18.863694 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:18.864619 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:18.865060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:18.891060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:18.892469 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:18.900203 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:18.900751 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:18.901758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:18.902386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:19.054048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:19.067021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4983c361-2c41-4a28-a856-a0423b4c399c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.213774 Aug 27 04:05:19.067475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 171/340] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:18 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:19.072095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:19.073007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:19.090943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:19.091419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:19.092184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:19.092625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:19.115911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:19.123557 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bf7f66a8-7d73-4173-a6d7-b73a66896cff tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.236416 Aug 27 04:05:19.124114 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 170/341] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:18 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:19.501262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-057432bd-67a8-442d-9457-a4b17190eecb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.432512 Aug 27 04:05:19.502131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 172/342] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:19 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:20.083910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:20.084709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:20.090969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:20.091466 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:20.092305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:20.092742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:20.141253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:20.141964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:20.148519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:20.149228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:20.150025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:20.150458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:20.252255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:20.260789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-32f34ebc-1f2f-4056-9d23-6310fd087a99 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.180806 Aug 27 04:05:20.261387 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 171/343] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:20 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:20.310183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:20.318149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-656d6504-c7f8-4f84-8cbe-b5ba0f8dbf02 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.181289 Aug 27 04:05:20.321436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 173/344] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:20 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:20.515864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:20.523058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:20.523058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:20.523248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:20.523978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:20.524413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:21.278162 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:21.278777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:21.285795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:21.286067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:21.286902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:21.287328 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:21.413134 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:21.420220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4f5a56f1-485b-468f-b24b-47eae419abb3 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.145722 Aug 27 04:05:21.420764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 174/345] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:21 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:21.425154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:21.425890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:21.432930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:21.433421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:21.434191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:21.434649 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:21.556344 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:21.563633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-42f8fece-7f5a-470e-8ac5-e95cabe301f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.141652 Aug 27 04:05:21.571746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 175/346] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:21 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:22.437500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:22.438194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:22.445043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:22.445497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:22.446267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:22.446733 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:22.574964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:22.583477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-939dffcc-64b0-4d58-ade6-20363498c82b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.149704 Aug 27 04:05:22.584278 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 176/347] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:22 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:22.588599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:22.589207 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:22.595633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:22.596406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:22.597282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:22.598088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:22.719900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:22.727319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ba8d1652-1c51-4d06-93ed-654dcc473341 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.142196 Aug 27 04:05:22.727884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 177/348] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:22 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:23.453421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4f6ca5e0-4ae5-417d-96c5-20f0058cc27a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 2.942829 Aug 27 04:05:23.458230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 172/349] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:20 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 2945 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:23.601377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:23.602050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:23.608095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:23.608541 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:23.609334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:23.609729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:23.732231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:23.740421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-34dc1ba0-ec9b-4396-abc1-91e7b53fbefa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.143896 Aug 27 04:05:23.740983 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 178/350] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:23 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:23.747699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:23.747699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:23.751794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:23.752292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:23.753059 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:23.754989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:23.899597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:23.908236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0cf7d43a-1075-4562-b2d3-8ca71ac1a7d2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.167675 Aug 27 04:05:23.909059 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 173/351] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:23 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:24.465365 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:24.466273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:24.473366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:24.473819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:24.474662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:24.475176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:24.567612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-843324b4-5362-48cd-b213-8a76c60c0df5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.105477 Aug 27 04:05:24.568686 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 179/352] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:24 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:24.758614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:24.760144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:24.771648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:24.772141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:24.773078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:24.773402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:24.897700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:24.905032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dd99d266-41e5-4995-9760-1252a253859a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.151692 Aug 27 04:05:24.905600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 174/353] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:24 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:24.926757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:24.928222 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:24.936006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:24.938378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:24.938493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:24.938976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:25.139822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:25.148735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-35a1858d-b705-4d58-948d-f04879338f16 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.227125 Aug 27 04:05:25.149316 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 180/354] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:24 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:25.580115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:25.580930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:25.586830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:25.587550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:25.588370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:25.601277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:25.740012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cb8fdb16-5201-4755-88fe-ba93e4c1e8f3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28226 microversion: 2.20 time: 0.163652 Aug 27 04:05:25.740695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 175/355] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:25 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28226 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:25.922594 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:25.923192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:25.929833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:25.930482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:25.931055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:25.931484 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:26.077910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:26.086085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fc5a967d-dbc7-4811-88ee-b1f238659ec9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.167211 Aug 27 04:05:26.087358 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 181/356] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:25 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:26.166309 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:26.167151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:26.174256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:26.174807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:26.176333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:26.177067 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:26.300095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:26.309800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aab6a65d-d134-4779-b572-760cfda7c5bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.146096 Aug 27 04:05:26.309800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 176/357] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:26 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:26.751422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:26.752333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:26.759724 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:26.760274 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:26.761169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:26.761617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:26.910811 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f4b49dff-abf9-46c3-832c-9cc5f289269e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28517 microversion: 2.20 time: 0.163203 Aug 27 04:05:26.911395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 182/358] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:26 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:27.103213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:27.103737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:27.109784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.110066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:27.111115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.111551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:27.309265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:27.319887 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d71bc418-203a-430e-b2d5-255331cfff75 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.219984 Aug 27 04:05:27.321178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 177/359] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:27 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:27.327825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:27.328740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:27.336236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.336679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:27.337669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.338104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:27.478245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:27.488752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c04ea7be-fb06-478e-9736-23b88c537273 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.165789 Aug 27 04:05:27.494644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 183/360] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:27 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:27.862575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-300fe508-0de1-45be-9b91-ea8028ddab9a req-bf8dd69b-e3c5-41b5-9a92-7f683500e7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8372e50f-df43-4829-b2c7-7d1a9334f817", "name": "network-vif-plugged", "status": "completed", "tag": "e27b77a5-6aea-4f02-b303-64570873e3a4"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:27.864660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:05:27.864660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:05:27.878016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-300fe508-0de1-45be-9b91-ea8028ddab9a req-bf8dd69b-e3c5-41b5-9a92-7f683500e7f9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.878816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-300fe508-0de1-45be-9b91-ea8028ddab9a req-bf8dd69b-e3c5-41b5-9a92-7f683500e7f9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:27.895829 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-300fe508-0de1-45be-9b91-ea8028ddab9a req-bf8dd69b-e3c5-41b5-9a92-7f683500e7f9 service nova] Creating event network-vif-plugged:e27b77a5-6aea-4f02-b303-64570873e3a4 for instance 8372e50f-df43-4829-b2c7-7d1a9334f817 on hv-cinder-80475 Aug 27 04:05:27.902867 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-300fe508-0de1-45be-9b91-ea8028ddab9a req-bf8dd69b-e3c5-41b5-9a92-7f683500e7f9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043750 Aug 27 04:05:27.903766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 178/361] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:05:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:27.925128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:27.927044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:27.937638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.938118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:27.940519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:27.942808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:28.078661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9dc38c4e-3d6d-46db-b5ee-52ceed1f63e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28517 microversion: 2.20 time: 0.157704 Aug 27 04:05:28.079841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 184/362] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:27 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:28.337182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:28.337892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:28.344099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:28.344550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:28.345437 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:28.345871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:28.475855 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:28.483348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-786016d5-3798-48c9-88c5-5f335377397b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.150254 Aug 27 04:05:28.483905 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 179/363] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:28 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:28.506151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:28.506759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:28.513883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:28.514419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:28.515373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:28.515830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:28.654773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:28.667962 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-26c6a677-a5f1-4381-bc59-db03789a796d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.166245 Aug 27 04:05:28.668932 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 185/364] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:28 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:29.093097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:29.094047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:29.100225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.100681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.101672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.102108 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.233505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-53642b78-82a8-4f35-bbac-179f54a7c594 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28517 microversion: 2.20 time: 0.144231 Aug 27 04:05:29.234404 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 180/365] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:29 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28517 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:29.501746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:29.502356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:29.510527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.511130 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.511805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.512535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.639064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:29.651152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c37d5d59-a7b0-4ed2-bfd0-69e384c16a36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1501 microversion: 2.1 time: 0.149096 Aug 27 04:05:29.651152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 186/366] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:29 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:29.664737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b91d02-4af9-4401-ae48-6746f9df9631"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:29.665871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:29.672581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.673783 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.674188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.674880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.684989 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:29.685603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:29.694234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.694973 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.696048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.696745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.721327 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] HTTP exception thrown: Cannot 'attach_volume' instance 715a2f59-8055-4b6e-a32f-07a45609c931 while it is in vm_state rescued Aug 27 04:05:29.721960 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Returning 409 to user: Cannot 'attach_volume' instance 715a2f59-8055-4b6e-a32f-07a45609c931 while it is in vm_state rescued {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:05:29.723684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-585a5442-bb3d-4064-a4ee-7d89ddcd4832 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063962 Aug 27 04:05:29.724698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 181/367] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:05:29 2021] POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:05:29.736288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:29.736828 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:29.744017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.744680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.745845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:29.746436 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:29.890682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:29.894409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-be6cb03c-30b5-4267-8fbe-3c2c9cfe893e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1318 microversion: 2.1 time: 0.212889 Aug 27 04:05:29.895370 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 187/368] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:29 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:30.009045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8b37c714-3c13-418d-b525-99b767a7eafb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action" status: 202 len: 0 microversion: 2.1 time: 0.279156 Aug 27 04:05:30.010596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 182/369] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:05:29 2021] POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:30.018451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:30.020014 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:30.026531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:30.027042 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:30.027820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:30.028256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:30.245138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:30.246614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:30.253615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:30.254357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:30.255258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:30.255790 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:30.294291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:30.304195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f65c6ffb-9edb-4239-a1bf-f0ed52d62d18 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1509 microversion: 2.1 time: 0.289650 Aug 27 04:05:30.305338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 188/370] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:30 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:30.374174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-74630929-5c17-4dfd-be81-cf734812a73b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.132988 Aug 27 04:05:30.379382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 183/371] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:30 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:30.917709 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:30.920303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:30.935499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:30.937305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:30.941096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:30.943707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:31.121689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:31.129453 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b38a4757-00f0-4504-bc3f-e2c20de7ba9c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1509 microversion: 2.1 time: 0.221145 Aug 27 04:05:31.130017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 189/372] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:30 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:31.323046 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:31.323738 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:31.330713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:31.331171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:31.332672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:31.333115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:31.386193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:31.387378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:31.393627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:31.394940 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:31.395788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:31.396232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:31.474310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:31.481718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-291b41db-b2a8-447f-be8f-d27487e68abb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1509 microversion: 2.1 time: 0.162590 Aug 27 04:05:31.482293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 184/373] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:31 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:31.527069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-206b6604-e32d-467d-af03-7c3845036c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.144397 Aug 27 04:05:31.527693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 190/374] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:31 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:32.498677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:32.499933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:32.507607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:32.508121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:32.509171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:32.509845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:32.540465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:32.542718 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:32.551731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:32.552658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:32.554446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:32.555143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:32.665259 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fc413614-940e-41ac-8dc6-df5c0ae91569 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.128993 Aug 27 04:05:32.665903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 191/375] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:32 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:32.683125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:32.691708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-474ebc93-d5b5-49b6-b1a9-8541cb556854 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1509 microversion: 2.1 time: 0.196021 Aug 27 04:05:32.692404 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 185/376] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:32 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1509 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:33.678613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:33.679764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:33.686547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:33.687039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:33.687826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:33.688267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:33.712924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:33.714160 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:33.720071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:33.720584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:33.721381 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:33.721811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:33.819362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1007d007-1aee-4f67-b64c-9279f1efd648 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.139309 Aug 27 04:05:33.820398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 192/377] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:33 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:33.905606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:33.912906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c81973c9-9014-4d39-8bd1-65551d26d4e0 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1509 microversion: 2.1 time: 0.204217 Aug 27 04:05:33.913476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 186/378] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:33 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:05:34.074168 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfbd25c6-e364-4a2e-8357-e77bb199ea02"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:34.075612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:34.083244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:34.083821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:34.084609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:34.085036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:34.834348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:34.836153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:34.844140 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:34.844582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:34.845389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:34.846200 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:34.996283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-721b9509-8ac5-4a3a-89e0-49c74001ac09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.164303 Aug 27 04:05:34.997382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 187/379] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:34 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:35.002651 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:35.004207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:35.019929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:35.019929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:35.019929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:35.019929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:35.208296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:35.219896 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-35c76f02-6832-4024-a1b7-083c55b4f65d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1515 microversion: 2.1 time: 0.221030 Aug 27 04:05:35.233053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 188/380] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:34 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:35.312331 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b488caa0-e3fe-487c-b592-ee8f40d23bfe tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.241401 Aug 27 04:05:35.313664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 193/381] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:05:34 2021] POST /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 194 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:36.009245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:36.010258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:36.018679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:36.020797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:36.021872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:36.022542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:36.137482 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-24faaea9-3602-443d-bdb1-2f8e3387e980 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.131837 Aug 27 04:05:36.138136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 189/382] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:36 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:37.151611 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:37.152751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:37.160566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:37.161110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:37.161865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:37.162296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:37.260540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-189e715a-9d62-429f-b21f-8eac46687a79 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.113145 Aug 27 04:05:37.261197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 194/383] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:37 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:38.273666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:38.274755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:38.282912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:38.286928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:38.286928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:38.286928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:38.376489 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-74be6f20-8ea0-4298-92f1-4e473dd72fb6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.108354 Aug 27 04:05:38.378024 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 190/384] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:38 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:38.644951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:38.645744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:38.652540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:38.653145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:38.653755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:38.654364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:38.795919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:05:38.804470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-03814648-8ede-4ea1-935b-d29017d64e36 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1515 microversion: 2.1 time: 0.163765 Aug 27 04:05:38.805047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 195/385] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:05:38 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:38.822427 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7186d0d-3e8a-4472-a5aa-1381fd39961a"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:38.823712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:38.830135 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:38.830830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:38.831562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:38.832008 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:39.389341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:39.390255 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:39.396540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:39.396991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:39.397769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:39.398205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:39.494296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c6384909-e337-4655-8305-9d9563a2e1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.108471 Aug 27 04:05:39.495856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 196/386] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:39 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:40.506443 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:40.508170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:40.514959 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:40.515656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:40.516095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:40.516530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:40.928455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7202f15b-86fa-4455-bcd2-8b2ea9ad53f8 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.110793 Aug 27 04:05:40.929034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 191/387] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:05:38 2021] POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments => generated 194 bytes in 2113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:05:44.630129 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ebbbb092-a04c-4351-9754-dec895890bd7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 4.127686 Aug 27 04:05:44.634798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 197/388] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:40 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 4130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:45.643688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:45.645379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:45.652528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:45.652976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:45.653789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:45.654219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:46.461184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dc9353f2-be50-4979-adef-7d6ef93d49a5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Action: 'create', calling method: .version_select at 0x7f539507a670>, body: {"keypair": {"name": "tempest-TestShelveInstance-2018250317"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:46.478922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-dc9353f2-be50-4979-adef-7d6ef93d49a5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Getting quotas for project 43ccefac7f3746c68214be66026da43d. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:05:46.482924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-dc9353f2-be50-4979-adef-7d6ef93d49a5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Getting quotas for user 0c8e2b8a0f3f49f4a3e20160ec0b0193 and project 43ccefac7f3746c68214be66026da43d. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:05:46.893128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-dc9353f2-be50-4979-adef-7d6ef93d49a5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Getting quotas for project 43ccefac7f3746c68214be66026da43d. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:05:46.898163 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-dc9353f2-be50-4979-adef-7d6ef93d49a5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Getting quotas for user 0c8e2b8a0f3f49f4a3e20160ec0b0193 and project 43ccefac7f3746c68214be66026da43d. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:05:46.917158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dc9353f2-be50-4979-adef-7d6ef93d49a5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.634646 Aug 27 04:05:46.918017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 198/389] 10.222.0.73 () {60 vars in 1158 bytes} [Fri Aug 27 04:05:46 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:05:49.880691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cbf50361-819e-4959-b37e-6ef4f7d139c4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 4.241351 Aug 27 04:05:49.881941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 192/390] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:45 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 4244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:50.894296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:50.895614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:50.903779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:50.904476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:50.905267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:50.905719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:51.044847 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f9497f44-50c0-4355-95e8-72454b9d7197 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.155353 Aug 27 04:05:51.045794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 199/391] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:50 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:52.058169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:52.059203 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:52.065957 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:52.074199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:52.074199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:52.074199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:52.256244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4f9e62bd-aeb8-452c-8755-27c18480594a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.201296 Aug 27 04:05:52.257207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 193/392] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:52 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:53.273922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:53.275742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:53.284953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:53.287183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:53.288259 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:53.288924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:53.348527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfbd25c6-e364-4a2e-8357-e77bb199ea02"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:53.349815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:53.358510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:53.359135 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:53.360128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:53.360658 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:53.400107 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5b23f4e0-1b0b-4840-bc06-ec521318db47 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.132015 Aug 27 04:05:53.401228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 200/393] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:53 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:53.471207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] HTTP exception thrown: Invalid volume: volume bfbd25c6-e364-4a2e-8357-e77bb199ea02 is already attached to instances: 8372e50f-df43-4829-b2c7-7d1a9334f817 Aug 27 04:05:53.471810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Returning 400 to user: Invalid volume: volume bfbd25c6-e364-4a2e-8357-e77bb199ea02 is already attached to instances: 8372e50f-df43-4829-b2c7-7d1a9334f817 {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:05:53.472787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7bc98f86-3f09-40b5-aa31-68b748353504 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129807 Aug 27 04:05:53.473428 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 194/394] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:05:53 2021] POST /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:05:53.576043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:53.576837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:53.585593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:53.588964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:53.588964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:53.588964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:53.706742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'services' on Instance uuid 8372e50f-df43-4829-b2c7-7d1a9334f817 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:05:54.059979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e30b760a-3d38-45f6-8646-5f9d7537b392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments/bfbd25c6-e364-4a2e-8357-e77bb199ea02" status: 202 len: 0 microversion: 2.1 time: 0.490147 Aug 27 04:05:54.068534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 201/395] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:05:53 2021] DELETE /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments/bfbd25c6-e364-4a2e-8357-e77bb199ea02 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:54.074157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:54.075426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:54.082652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:54.083510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:54.084542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:54.085361 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:54.123398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-08204d9f-3436-435c-9592-c690260e0a11 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052083 Aug 27 04:05:54.123927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 195/396] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:54 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:54.413335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:54.415093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:54.422275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:54.423035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:54.424274 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:54.425005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:54.531749 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e8f78e6f-0287-44ff-a74c-433ca0dc60bb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.122630 Aug 27 04:05:54.532396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 202/397] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:54 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:55.137703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:55.138812 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:55.145370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:55.145818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:55.146626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:55.147069 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:55.178731 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-efbfd8d0-0c5f-470d-86e0-bde047d2063d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Aug 27 04:05:55.179306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 196/398] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:55 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:55.544638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:55.545879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:55.553812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:55.554348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:55.555255 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:55.555770 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:55.665149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-799207e3-c65d-4f50-9fbc-8fb075886373 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.124418 Aug 27 04:05:55.679688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 203/399] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:55 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:56.190801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:56.192203 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:56.203940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:56.204390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:56.205196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:56.205627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:56.235113 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-80024571-79d2-42bf-bbce-533ca7052cf2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048089 Aug 27 04:05:56.235584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 197/400] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:56 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:56.691647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:56.693205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:56.700496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:56.700940 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:56.701709 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:56.702139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:56.824025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ee3609dc-272a-42a6-8218-34249325326c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.137542 Aug 27 04:05:56.824797 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 204/401] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:56 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:05:57.248509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:57.249546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:57.257241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:57.257771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:57.258721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:57.259232 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:57.300026 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fe2f5468-0cf8-4ce3-add1-414a26a41847 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053736 Aug 27 04:05:57.307004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 198/402] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:57 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:57.837056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:57.838290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:57.845105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:57.845567 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:57.846367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:57.846836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:57.963111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-668d14e1-0256-4a45-b42c-d7f5e11ee8a3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.130549 Aug 27 04:05:57.963906 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 205/403] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:57 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:58.311915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:58.316892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:58.319242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:58.322815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:58.322815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:58.322815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:58.358612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2c8e3a00-8e7a-4d4d-84af-bd83cacd28bf tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050560 Aug 27 04:05:58.359175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 199/404] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:58 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:05:58.976780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:05:58.979931 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:58.986458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:58.986952 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:58.990373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:58.990373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:59.270910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-319ea303-7106-4918-8e53-53492de48fe2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.299663 Aug 27 04:05:59.271863 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 206/405] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:05:58 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:05:59.371814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:05:59.372859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:05:59.378640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:59.385176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:59.385176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:05:59.385176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:05:59.411268 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b09f5a67-e239-4077-9e6a-ab4928953f17 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043653 Aug 27 04:05:59.413084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 200/406] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:05:59 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:00.283599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:00.284730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:00.292337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:00.293021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:00.293810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:00.294392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:00.406172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8a72d5ce-4fd8-49e8-97fc-515750559bd0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.126995 Aug 27 04:06:00.410162 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 207/407] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:00 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:00.429154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:00.430741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:00.439753 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:00.440303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:00.441293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:00.441734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:00.485481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9de9c08a-acf6-4c44-9d0f-35da3dbfcfae tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060042 Aug 27 04:06:00.486260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 201/408] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:06:00 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:00.578046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:00.579307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:00.586379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:00.586865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:00.587653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:00.588294 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:00.613689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lazy-loading 'flavor' on Instance uuid 715a2f59-8055-4b6e-a32f-07a45609c931 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:06:01.123327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3d912b12-7d8c-4c3a-b330-8d8eb584ba40 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action" status: 200 len: 32 microversion: 2.1 time: 0.553590 Aug 27 04:06:01.123925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 208/409] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:06:00 2021] POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action => generated 32 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:06:01.133376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:01.133981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:01.140296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:01.140739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:01.141500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:01.141926 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:01.309936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:01.320831 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9d3a10ab-9bdd-46fa-b365-300750437abd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.190229 Aug 27 04:06:01.320831 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 202/410] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:01 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:01.420859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:01.422206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:01.429262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:01.439930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:01.439930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:01.439930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:01.497247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:01.498548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:01.504826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:01.505329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:01.506115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:01.506550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:01.536327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ff361d78-d2c8-45ed-81f3-654f92e4387a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.120414 Aug 27 04:06:01.537211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 209/411] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:01 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:01.545868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-46f5c3ac-e993-4dfe-8e51-bec5a732aba3 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052186 Aug 27 04:06:01.550500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 203/412] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:06:01 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:02.339206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:02.340273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:02.346924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:02.354363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:02.354363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:02.354363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:02.495254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:02.503114 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-055253c6-cdad-402c-8fa2-19f77a04e88e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.168178 Aug 27 04:06:02.503687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 210/413] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:02 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:02.548998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:02.549930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:02.557211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:02.557652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:02.558422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:02.558883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:02.561178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:02.562149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:02.568582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:02.569032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:02.569825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:02.570262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:02.608872 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4339e03a-683e-45cd-8e0b-22cd599359ed tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051412 Aug 27 04:06:02.609429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 211/414] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:06:02 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:06:02.657675 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b37c413c-41c3-4e77-8393-93208bf72570 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.112630 Aug 27 04:06:02.658320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 204/415] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:02 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:03.291126 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1645522927", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "bd5cbeee-0483-497b-a816-2825652e56f8"}]}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:03.350302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.network.neutron [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] validate_networks() for [('bd5cbeee-0483-497b-a816-2825652e56f8', None, None, None, None, None)] {{(pid=108986) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:06:03.522280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:03.523022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:03.529453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:03.529909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:03.530746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:03.531192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:03.769521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:03.785424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4ac4b1e5-a60f-4530-b61a-41191fbd1aa5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.267341 Aug 27 04:06:03.786908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 205/416] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:03 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:03.792555 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:03.793544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:03.801909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:03.802626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:03.803762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:03.804588 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:03.806169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:06:03.806740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:06:03.807794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Flavor pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:06:03.808041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Image pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:06:03.808609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:06:03.825186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:03.825641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:03.826456 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:03.826990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:03.847436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:06:03.852180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Getting quotas for user a21ac4ce459d4eee9f73d4c7207968b4 and project c67ffd3553c245acabcdcfd5a15252e3. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:06:03.863509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Going to run 1 instances... {{(pid=108986) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:06:03.866679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:06:03.903302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3f2df632-b031-4442-ab2c-478c0bbba99d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.115150 Aug 27 04:06:03.903915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 206/417] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:03 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:04.003265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9f2ad7f4-0de8-486b-88f1-ed89cc912c33 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715638 Aug 27 04:06:04.003909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 212/418] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:06:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 27 04:06:04.032882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dde99e6c-129f-4ca9-99c2-6af856710831 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:04.033596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dde99e6c-129f-4ca9-99c2-6af856710831 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:04.102622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dde99e6c-129f-4ca9-99c2-6af856710831 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:04.115017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dde99e6c-129f-4ca9-99c2-6af856710831 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1218 microversion: 2.1 time: 0.085829 Aug 27 04:06:04.116315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 207/419] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:04 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:04.806853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:04.807608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:04.813770 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:04.814300 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:04.815224 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:04.815673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:04.914940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:04.915845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:04.923088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:04.923537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:04.924330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:04.924765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:04.954494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:04.961851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-193b4f47-41cd-4707-9227-14a42647b0cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.159076 Aug 27 04:06:04.962429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 213/420] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:04 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:05.031895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-309f3e48-9ca1-4a5d-bc05-15a741519233 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.120455 Aug 27 04:06:05.032529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 208/421] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:04 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:05.132376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:05.132892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:05.139788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:05.140235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:05.141189 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:05.141626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:05.201265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:05.209992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-810e2caa-40a7-420d-b0c8-9fe077b58198 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1222 microversion: 2.1 time: 0.081195 Aug 27 04:06:05.210485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 214/422] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:05 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:05.980620 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:05.981387 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:05.992173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:05.992618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:05.993396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:05.993831 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:06.044379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:06.045475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:06.055336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:06.055336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:06.055336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:06.055336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:06.125459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:06.133290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bcffa161-0acb-4dd5-ad75-201140671586 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.157328 Aug 27 04:06:06.133845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 209/423] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:05 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:06.178143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-56c82230-a34a-480a-840c-9def4ea8bbc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.137263 Aug 27 04:06:06.178739 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 215/424] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:06 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:06.230401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:06.231111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:06.237163 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:06.237613 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:06.238382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:06.238969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:06.318743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:06.326884 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d8de3cd4-ffde-4724-b195-a8838fb6d3f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1270 microversion: 2.1 time: 0.100145 Aug 27 04:06:06.327502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 210/425] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:06 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:07.150675 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:07.151369 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:07.157871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:07.158324 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:07.159113 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:07.159719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:07.189684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:07.191049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:07.199016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:07.199554 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:07.200459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:07.201012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:07.350074 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:07.357892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-338dd6b4-85a2-4ab6-bd22-6e561ab3bf33 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.211314 Aug 27 04:06:07.358905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 216/426] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:07 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:07.363139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:07.364014 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:07.370286 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:07.370767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:07.371548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:07.371986 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:07.494402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:07.501874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-88ce3064-a0d9-404d-ac7f-155c015f19d7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.142038 Aug 27 04:06:07.502434 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 217/427] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:07 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:08.375936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:08.376559 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:08.383209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:08.383657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:08.384599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:08.385182 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:08.510816 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:08.518492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-61e78fae-f4d9-44c3-957c-fd9bd82ee310 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.146120 Aug 27 04:06:08.519110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 218/428] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:08 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:08.524622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:08.525227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:08.530969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:08.531425 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:08.532196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:08.532630 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:08.661086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:08.668261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9e4336c5-006f-4369-ab12-d2cf1d2880e2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.148153 Aug 27 04:06:08.672544 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 219/429] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:08 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:09.535147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:09.536567 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:09.542604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:09.543056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:09.543831 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:09.544264 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:09.669277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:09.678965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-19528af5-7ce9-441e-91f5-8d3d6940eb98 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.147388 Aug 27 04:06:09.679534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 220/430] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:09 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:09.686956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:09.687570 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:09.693722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:09.694177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:09.694994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:09.695433 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:09.820093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:09.827922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cd16e2da-1439-4922-b15b-9202015c1c50 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.144332 Aug 27 04:06:09.828510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 221/431] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:09 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:10.710748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:10.711375 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:10.717992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:10.718441 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:10.719249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:10.719687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:10.854190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:10.861967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-86d61e9c-5cb4-4093-8b0d-30706f9fc27f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.155662 Aug 27 04:06:10.862519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 222/432] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:10 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:10.867075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:10.867680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:10.874780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:10.875360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:10.876143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:10.876582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:11.001164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:11.009950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0f491d6e-6770-45e6-8baf-0c818cfd10dc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.146433 Aug 27 04:06:11.010517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 223/433] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:10 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:11.882870 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:11.883654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:11.890452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:11.890941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:11.891728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:11.892170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:12.020879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:12.030713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-362a79e1-d5cc-46b3-a8f3-fab0cb89edf5 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.154627 Aug 27 04:06:12.031396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 224/434] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:11 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:12.039979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:12.041126 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:12.051719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:12.052947 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:12.053350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:12.053797 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:12.196910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:12.204471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a895e9b9-365b-4c9b-8ae0-cb07e530372b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.171717 Aug 27 04:06:12.205045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 225/435] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:12 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:12.464091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-773ab50d-f0ce-4b00-a949-698b8eea2ba1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 5.276824 Aug 27 04:06:12.464091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 211/436] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:07 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 5279 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:13.058967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:13.060874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:13.069072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.070301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.071391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.072235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.221704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:13.222405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:13.229152 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.229610 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.230386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.230860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.241176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:13.261314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0c1abffd-773f-423a-8dfe-dd7260d27028 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.195032 Aug 27 04:06:13.261314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 226/437] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:13 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:13.269530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-7dd387e8-3277-4650-85e4-c15cdfea1b71 req-82e724c5-4ce6-4b1a-8c80-53743fe4efb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f022fee3-a0a6-49ea-bd1f-283627d16159", "tag": "c7b390d3-307b-4783-8110-7fc1b14d1e6e"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:13.272485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:06:13.272485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:06:13.283600 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-7dd387e8-3277-4650-85e4-c15cdfea1b71 req-82e724c5-4ce6-4b1a-8c80-53743fe4efb6 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.284137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-7dd387e8-3277-4650-85e4-c15cdfea1b71 req-82e724c5-4ce6-4b1a-8c80-53743fe4efb6 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.297720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-7dd387e8-3277-4650-85e4-c15cdfea1b71 req-82e724c5-4ce6-4b1a-8c80-53743fe4efb6 service nova] Creating event network-changed:c7b390d3-307b-4783-8110-7fc1b14d1e6e for instance f022fee3-a0a6-49ea-bd1f-283627d16159 on hv-cinder-80475 Aug 27 04:06:13.303162 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-7dd387e8-3277-4650-85e4-c15cdfea1b71 req-82e724c5-4ce6-4b1a-8c80-53743fe4efb6 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043743 Aug 27 04:06:13.303761 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 227/438] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:06:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:13.435029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:13.435674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e7fc1840-3b9e-44a1-aadc-308f1775a973 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.217921 Aug 27 04:06:13.436255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 212/439] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:13 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:13.477937 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:13.479069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:13.485461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.485993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.486893 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:13.487404 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:13.774427 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-37040c4e-a600-48e5-949b-2f7b3a1d8c9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.301244 Aug 27 04:06:13.775100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 228/440] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:13 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:14.271106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:14.272154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:14.281627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:14.282294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:14.283298 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:14.283967 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:14.454460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:14.455307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:14.466512 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:14.467169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:14.468492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:14.468952 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:14.499456 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:14.509995 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7abdf5e5-2e1d-4ebf-b5af-359681f2833f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.244755 Aug 27 04:06:14.510826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 213/441] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:14 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:14.617453 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:14.626199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0dbfa465-d3b9-4e2f-9ccb-27c93f716a73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.176830 Aug 27 04:06:14.626877 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 229/442] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:14 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:14.786685 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:14.787657 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:14.794040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:14.794883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:14.795304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:14.795736 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:15.528489 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:15.529104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:15.535673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:15.536129 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:15.537421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:15.537859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:15.672610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:15.681597 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-86f8e9db-efc5-4805-9843-f210a95c96bd tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.156753 Aug 27 04:06:15.682168 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 230/443] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:15 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:15.686586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:15.687483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:15.695157 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:15.695605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:15.696385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:15.696821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:15.828512 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:15.836240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-65aa2b26-7b35-4488-ae59-600c0a2ce8af tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.152956 Aug 27 04:06:15.837097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 231/444] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:15 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:16.698984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:16.699634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:16.707424 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:16.708049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:16.709929 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:16.710585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:16.854829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:16.862681 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-db4223ca-54b4-4ec1-a892-cbb2aac42e20 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.167346 Aug 27 04:06:16.863200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 232/445] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:16 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:16.868544 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:16.869151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:16.875621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:16.876131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:16.876908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:16.877337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:17.006051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:17.013490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-edf6803b-73f4-41fd-9ccc-ce5e7b3da2b8 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.149242 Aug 27 04:06:17.014051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 233/446] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:16 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:17.880095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:17.881351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:17.887514 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:17.887973 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:17.888750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:17.889206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:18.010537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:18.018346 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b27439f0-fd8a-43a9-bf67-7fce9d960aaa tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.141983 Aug 27 04:06:18.018936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 234/447] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:17 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:18.030848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:18.031461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:18.037861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:18.038308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:18.039100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:18.039540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:18.166189 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:18.173970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-04fd79e7-5b24-4c67-9c43-9ee49f107a3c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.146817 Aug 27 04:06:18.174525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 235/448] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:18 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:19.035748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:19.036396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:19.042590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:19.043051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:19.043833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:19.044273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:19.175551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:19.184977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-de9f99bf-7002-477f-8d50-98ce23c2ab6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.152853 Aug 27 04:06:19.185780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 236/449] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:19 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:19.191038 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:19.191712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:19.198332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:19.198822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:19.199608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:19.200053 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:19.200190 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-635b92f8-b10e-48f7-9ed4-726417f837a0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 4.416954 Aug 27 04:06:19.200988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 214/450] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:14 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 4419 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:19.325147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:19.333236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b49d22ca-7c6c-4a4b-80e0-0e6b56b4dfa9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.146105 Aug 27 04:06:19.334375 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 237/451] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:19 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:20.203045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:20.203767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:20.210385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:20.210929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:20.211733 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:20.211834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:20.212240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:20.212705 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:20.218517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:20.219022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:20.219793 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:20.220236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:20.339045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:20.346770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a2f7c543-ebc3-4682-a79b-48ed51f5bfd9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.147692 Aug 27 04:06:20.353636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 215/452] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:20 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:20.353636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:20.353636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:20.357628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:20.358070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:20.358868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:20.359330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:20.397505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a94dab7d-0431-4a24-9dd2-e50bf4ceb962 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.189398 Aug 27 04:06:20.398309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 238/453] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:20 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:20.481287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:20.488792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-465e50b8-9b9b-4514-b0b5-3824397b9591 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.140499 Aug 27 04:06:20.489355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 216/454] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:20 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:21.364970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:21.365666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:21.372971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:21.373424 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:21.374302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:21.374812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:21.409082 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:21.410141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:21.417886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:21.418471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:21.424085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:21.424085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:21.506509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:21.515033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-92f6f4fa-180f-44a6-b7d7-9ba6a441fc6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.154213 Aug 27 04:06:21.515650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 239/455] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:21 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:21.519806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:21.520441 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:21.526460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:21.526953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:21.527738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:21.528170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:21.640677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fe6a75ba-3752-4c39-8e27-42ce1ad05341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.235097 Aug 27 04:06:21.641423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 217/456] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:21 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:21.660316 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:21.669254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f0fd72f2-b7a1-4961-a2e5-627268791528 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.152468 Aug 27 04:06:21.669838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 240/457] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:21 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:22.533542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:22.533542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:22.540434 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:22.540884 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:22.541673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:22.547808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:22.652883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:22.653813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:22.660782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:22.661241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:22.662046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:22.662608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:22.690912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:22.701106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d1bebefe-83c0-4596-b0e3-52aa5fe5fb04 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.172965 Aug 27 04:06:22.701683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 218/458] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:22 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:22.706261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:22.706897 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:22.713783 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:22.713783 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:22.715028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:22.715460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:22.845390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:22.853327 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ca32ac1a-6674-4ebc-950c-bc9f611d7a56 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.150656 Aug 27 04:06:22.853897 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 219/459] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:22 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:23.720976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:23.721844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:23.729157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:23.729647 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:23.730465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:23.730969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:23.860474 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:23.868731 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aa853181-a992-415e-89ce-13bfce27e981 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.151397 Aug 27 04:06:23.869290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 220/460] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:23 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:23.873698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:23.874292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:23.880866 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:23.881307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:23.882642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:23.883073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:24.052007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:24.052007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2b63af83-2d2d-49a3-b505-9d7cae164535 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.157027 Aug 27 04:06:24.052007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 221/461] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:23 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:24.891251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:24.891945 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:24.898548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:24.899028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:24.899843 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:24.900327 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:25.034785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:25.043304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8c930ef6-08d9-446d-a1f8-8f7e0a24a457 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.158432 Aug 27 04:06:25.043861 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 222/462] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:24 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:25.048300 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:25.048891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:25.055674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:25.055674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:25.056460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:25.056890 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:25.183925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:25.191874 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-572559ed-86de-461d-9c56-0b561d815d8e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.147016 Aug 27 04:06:25.192489 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 223/463] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:25 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:26.060271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:26.060955 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:26.067188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:26.067634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:26.068403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:26.068838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:26.191796 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:26.200761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d6640c32-0c8c-4142-bcd2-c88a116b2516 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.144136 Aug 27 04:06:26.201334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 224/464] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:26 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:26.208473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:26.209110 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:26.216260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:26.216708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:26.217484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:26.217924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:26.346293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:26.357319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f7205395-29b0-4058-a58c-e3d8ff8d67ce tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.152082 Aug 27 04:06:26.358061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 225/465] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:26 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:27.218075 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:27.218846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:27.225179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:27.225667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:27.226540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:27.227722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:27.356723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:27.364595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7afe19a2-c8ab-46cd-a38f-815f66858a0a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.150182 Aug 27 04:06:27.365153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 226/466] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:27 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:27.373393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:27.373999 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:27.380296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:27.380751 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:27.381524 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:27.381958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:27.512388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:27.521302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6e86b45a-e000-4a26-801c-9718879d71ec tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.151185 Aug 27 04:06:27.522321 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 227/467] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:27 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:28.382008 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:28.382657 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:28.389696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:28.390144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:28.390998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:28.391455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:28.529248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:28.537411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-42b5d025-08d9-48af-9ce4-c6ffcd585717 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.159156 Aug 27 04:06:28.537976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 228/468] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:28 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:28.542328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:28.542951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:28.549439 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:28.549950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:28.550761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:28.551198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:28.688401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:28.696979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-eea4f108-8e7a-4b46-b4f5-f3cb35aa6a1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.157140 Aug 27 04:06:28.697750 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 229/469] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:28 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:29.109889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3c1e3403-f799-4119-9507-e975109cbdbd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 6.460507 Aug 27 04:06:29.110890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 241/470] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:22 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 6462 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:29.556987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:29.558621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:29.573423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:29.573423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:29.573423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:29.573423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:29.703530 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:29.713163 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b6106302-26bf-4dac-ad8b-3515c15913e2 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.159512 Aug 27 04:06:29.714389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 230/471] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:29 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:29.730247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:29.731392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:29.738373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:29.738933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:29.739800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:29.740376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:29.885878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:29.893728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a0503967-eb37-4de1-9948-894d359eb604 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.173470 Aug 27 04:06:29.894295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 242/472] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:29 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:30.121661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:30.122593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:30.129173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:30.129908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:30.130473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:30.130937 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:30.733255 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:30.733978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:30.740340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:30.740786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:30.741657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:30.742093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:30.864753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:30.873196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-38dd1b0c-bb6a-4640-9665-fb7e9a1286fc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.145578 Aug 27 04:06:30.874102 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 243/473] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:30 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:30.910736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:30.911346 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:30.917398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:30.917844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:30.918633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:30.919068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:31.039710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:31.048013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-37e2e143-e030-4740-928f-0612c2cf79da tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.140551 Aug 27 04:06:31.048586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 244/474] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:30 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:31.890963 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:31.891610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:31.897684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:31.898072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:31.898881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:31.899310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:32.029329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:32.037050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f77d423f-4eaa-470f-b85a-89cb94806a9e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.149959 Aug 27 04:06:32.037603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 245/475] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:31 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:32.065698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:32.066297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:32.072634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:32.073289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:32.074092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:32.074527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:32.195721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:32.203719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f7d3623b-c2ac-4f94-8b28-9faea430d58c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.141512 Aug 27 04:06:32.204280 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 246/476] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:32 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:33.054032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:33.054768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:33.061629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:33.062088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:33.062907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:33.063350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:33.183837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:33.191948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-48a98871-560b-46ef-a61f-13e49834e957 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.141657 Aug 27 04:06:33.192684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 247/477] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:33 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:33.220240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:33.221109 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:33.226951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:33.227439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:33.228837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:33.229844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:33.358197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:33.365410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-294a7576-bb7b-4ace-b9f1-e26742d43517 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.148856 Aug 27 04:06:33.365980 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 248/478] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:33 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:34.209395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:34.210049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:34.216647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:34.217097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:34.217865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:34.218296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:34.335580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:34.344239 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7a415849-2335-42c2-b28a-bd9325e821fb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.138420 Aug 27 04:06:34.344827 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 249/479] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:34 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:34.382653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:34.383273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:34.389888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:34.390339 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:34.391144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:34.391582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:34.515708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:34.523070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8c6719e4-29d4-4926-8f5e-4ed26152f1a2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.144013 Aug 27 04:06:34.523644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 250/480] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:34 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:35.361225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:35.361961 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:35.368120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:35.368566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:35.369904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:35.370350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:35.501659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:35.511945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cc0b6604-c045-4d3e-ac0a-8100ad312166 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.154407 Aug 27 04:06:35.512564 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 251/481] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:35 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:35.540926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:35.541625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:35.544210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-00ff5011-ee7c-46eb-b287-4bbfd5db35ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 5.426250 Aug 27 04:06:35.544879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 231/482] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:30 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 5428 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:35.549849 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:35.550331 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:35.551150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:35.551595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:35.707590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:35.715812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d6392ace-87e2-4342-a7a8-ebb242077411 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.177826 Aug 27 04:06:35.716422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 252/483] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:35 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:36.532033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:36.532729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:36.539004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:36.539455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:36.540241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:36.540676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:36.556708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:36.557729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:36.564318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:36.564765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:36.565555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:36.565988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:36.672185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:36.679016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7c7744ad-9728-46da-8546-fc956de33bbf tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.153122 Aug 27 04:06:36.679586 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 232/484] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:36 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:36.697321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a3e6a2d5-8b19-49e6-9523-1fba44d9a4f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.144123 Aug 27 04:06:36.697990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 253/485] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:36 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:36.732610 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:36.733216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:36.739233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:36.739666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:36.740433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:36.740866 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:36.870296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:36.877996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7b601d92-01fb-44bd-8ae7-dd09635c7326 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.149139 Aug 27 04:06:36.878543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 233/486] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:36 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:37.700788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:37.701575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:37.708209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:37.708664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:37.709492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:37.709936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:37.721752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:37.722674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:37.729217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:37.729714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:37.730692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:37.731130 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:37.835752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:37.843390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-064d0377-6b81-4f7c-9e10-44ec296c0317 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.125056 Aug 27 04:06:37.844155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 234/487] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:37 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:37.844764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fe9f5e5f-7ba7-4a24-91a7-8e210b4eec5d tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1567 microversion: 2.1 time: 0.148758 Aug 27 04:06:37.845388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 254/488] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:37 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:37.895223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:37.895992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:37.903608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:37.904078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:37.904863 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:37.905367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:38.030672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:38.037917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e21bd846-116f-456f-877c-a91e47cec5d9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.146874 Aug 27 04:06:38.038478 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 235/489] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:37 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:38.855771 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:38.856991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:38.861529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:38.864609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:38.865068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:38.865863 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:38.866297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:38.872631 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:38.879294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:38.879773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:38.880559 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:38.880996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:38.981000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-98426f60-7b30-4a63-9dad-5a46055d71d8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.128810 Aug 27 04:06:38.981737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 255/490] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:38 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:39.017899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:39.026320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e271f692-69dc-4b0e-8d95-e733011981d7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1547 microversion: 2.1 time: 0.168549 Aug 27 04:06:39.027128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 236/491] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:38 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:39.052885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:39.053661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:39.056800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:39.057609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:39.062081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.062794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.063968 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.064678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.065979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.066356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.067291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.067648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.188783 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] HTTP exception thrown: Cannot 'detach_volume' instance 715a2f59-8055-4b6e-a32f-07a45609c931 while it is in vm_state rescued Aug 27 04:06:39.189397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Returning 409 to user: Cannot 'detach_volume' instance 715a2f59-8055-4b6e-a32f-07a45609c931 while it is in vm_state rescued {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:06:39.190243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f34143b4-b6c2-4c65-ba17-4e6bac062257 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments/e7186d0d-3e8a-4472-a5aa-1381fd39961a" status: 409 len: 152 microversion: 2.1 time: 0.148874 Aug 27 04:06:39.190846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 256/492] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:06:39 2021] DELETE /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments/e7186d0d-3e8a-4472-a5aa-1381fd39961a => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:06:39.199051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:39.199511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:39.205269 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.205718 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.206552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.207022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.222056 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:39.229488 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-64450c24-eccb-4a61-bfdb-6d4ee9cf8771 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.177148 Aug 27 04:06:39.233416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 237/493] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:39 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:39.612620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-abdbf33d-f186-488d-95a1-3ab3b35fdf62 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action" status: 202 len: 0 microversion: 2.1 time: 0.416920 Aug 27 04:06:39.613321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 257/494] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:06:39 2021] POST /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:39.621980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:39.622618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:39.628629 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.629084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.629907 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:39.630334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:39.749764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:39.757845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9d376549-ff53-417d-948d-a31664de3499 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1555 microversion: 2.1 time: 0.140270 Aug 27 04:06:39.758509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 238/495] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:39 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1555 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:39.995523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:39.997054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:40.003625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.004068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.004894 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.005325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.106862 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2da717b2-4f35-49c2-bf1f-15b3a11cdfcc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.117363 Aug 27 04:06:40.107501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 258/496] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:39 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:40.247355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:40.248001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:40.254179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.254666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.255787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.256282 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.384496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:40.392428 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-908aa3de-4cc3-4105-a28d-1dcdacdd8d81 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.149457 Aug 27 04:06:40.392989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 239/497] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:40 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:40.776254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:40.776960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:40.783806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.784255 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.785034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:40.785472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:40.931472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:40.939990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-616e053e-2aa0-4c0f-a817-cc04d18e637c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1555 microversion: 2.1 time: 0.167864 Aug 27 04:06:40.941882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 259/498] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:40 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:41.118430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:41.119385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:41.125809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:41.126288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:41.127061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:41.127494 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:41.241748 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-00ddd893-fdaf-4313-9a2e-3e1e09d5de48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.126763 Aug 27 04:06:41.242696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 240/499] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:41 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:41.409669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:41.410281 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:41.416528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:41.420398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:41.420398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:41.420398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:41.543902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:41.552237 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-96ae383c-ae59-4d2e-9982-2a518c13d029 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.146500 Aug 27 04:06:41.552822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 260/500] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:41 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:41.957899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:41.958656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:41.966318 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:41.966806 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:41.967679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:41.968185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:42.099981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:42.108974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-78830dc0-d8df-4303-ad69-73145d4dcbe7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1555 microversion: 2.1 time: 0.155200 Aug 27 04:06:42.109606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 241/501] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:41 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:42.263385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:42.263385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:42.263385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:42.263385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:42.263757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:42.263757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:42.270340 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2119868515", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2018250317", "security_groups": [{"name": "tempest-secgroup-smoke-1208184773"}], "networks": [{"uuid": "c57305fa-e10d-427e-9a68-12061ec92767"}], "block_device_mapping_v2": [{"uuid": "1e50c1cf-d3a3-40ad-9f04-ca17379b926f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:42.395177 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] validate_networks() for [('c57305fa-e10d-427e-9a68-12061ec92767', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:06:42.495410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-20945498-24c5-49e7-8f04-a40c1a7eb0d6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.245600 Aug 27 04:06:42.496197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 261/502] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:42 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:42.575095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:42.576649 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:42.588145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:42.588860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:42.590877 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:42.597252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:42.768458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:42.776781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b76f0626-0eb9-4a96-a1e2-75e5a30bfb1f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.209152 Aug 27 04:06:42.781531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 262/503] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:42 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:42.999739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:06:43.000324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:06:43.000901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:06:43.001668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:06:43.002150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:06:43.016303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.016303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.016303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.016303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.044942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Getting quotas for project 43ccefac7f3746c68214be66026da43d. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:06:43.049786 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Getting quotas for user 0c8e2b8a0f3f49f4a3e20160ec0b0193 and project 43ccefac7f3746c68214be66026da43d. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:06:43.123612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:06:43.125763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e50c1cf-d3a3-40ad-9f04-ca17379b926f',volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:06:43.128628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:43.131439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:43.137378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.138254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.139175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.139707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.294396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:43.304518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2096deb0-2eb3-4181-9556-c47e6d6fe9ae tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1555 microversion: 2.1 time: 0.180606 Aug 27 04:06:43.305364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 263/504] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:43 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:43.506596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:43.514712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:43.514712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.514712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.515427 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.515869 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.553406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-10746f6f-2c6e-427e-9bb6-bd7b9787a657 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.288516 Aug 27 04:06:43.562605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 242/505] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:06:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:06:43.568050 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ef63148c-94e3-4772-91c6-0f054342db30 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:43.568659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ef63148c-94e3-4772-91c6-0f054342db30 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:43.629463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ef63148c-94e3-4772-91c6-0f054342db30 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:43.634863 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ef63148c-94e3-4772-91c6-0f054342db30 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1089 microversion: 2.1 time: 0.070589 Aug 27 04:06:43.635717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 243/506] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:43 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1089 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:43.636899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c5b66d3f-0591-406f-8c83-da97ad501d70 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.133555 Aug 27 04:06:43.637635 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 264/507] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:43 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:43.798474 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:43.799137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:43.805159 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.805614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.806387 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:43.806853 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:43.938100 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:43.945829 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-11d4e2ab-889e-49b3-bb06-754f0417ee05 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.151153 Aug 27 04:06:43.946514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 244/508] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:43 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:44.322945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:44.323709 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:44.331506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.332051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.332914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.333530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.488242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:44.496628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b994bd01-832c-4e07-a698-c8f7677a7b2f tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1555 microversion: 2.1 time: 0.177041 Aug 27 04:06:44.497478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 265/509] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:44 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:44.649039 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:44.650030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:44.658539 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:44.659464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.659637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:44.659791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.660221 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.660725 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.665626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.666200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.667106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.667680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.736354 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:44.743774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7346333f-9478-41bb-891c-8bf133920878 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1139 microversion: 2.1 time: 0.089355 Aug 27 04:06:44.744351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 266/510] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:44 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:44.754102 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-abe20e86-c7f6-41b9-8061-c96d5903f6eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.108841 Aug 27 04:06:44.754784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 245/511] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:44 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:44.762934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-13d04d24-a8a5-4bfe-8de3-797d227f66c8 req-4270adaa-fb83-49d5-81b4-17030ac19e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022fee3-a0a6-49ea-bd1f-283627d16159", "name": "network-vif-plugged", "status": "completed", "tag": "c7b390d3-307b-4783-8110-7fc1b14d1e6e"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:44.762934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:06:44.762934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:06:44.769013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-13d04d24-a8a5-4bfe-8de3-797d227f66c8 req-4270adaa-fb83-49d5-81b4-17030ac19e9a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.769455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-13d04d24-a8a5-4bfe-8de3-797d227f66c8 req-4270adaa-fb83-49d5-81b4-17030ac19e9a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.781641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-13d04d24-a8a5-4bfe-8de3-797d227f66c8 req-4270adaa-fb83-49d5-81b4-17030ac19e9a service nova] Creating event network-vif-plugged:c7b390d3-307b-4783-8110-7fc1b14d1e6e for instance f022fee3-a0a6-49ea-bd1f-283627d16159 on hv-cinder-80475 Aug 27 04:06:44.791144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-13d04d24-a8a5-4bfe-8de3-797d227f66c8 req-4270adaa-fb83-49d5-81b4-17030ac19e9a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Aug 27 04:06:44.791144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 267/512] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:06:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:44.968676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:44.969470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:44.976286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.976823 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:44.978198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:44.978198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.189652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:45.197677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8bfd2db2-c923-499d-94aa-e9caf9a5aafc tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.237796 Aug 27 04:06:45.198759 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 246/513] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:44 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:45.514016 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:45.514866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:45.521285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.521970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.522807 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.523251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.719014 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:45.728425 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-64eb776a-c96a-4085-a1f4-96c5a8468d61 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1561 microversion: 2.1 time: 0.218802 Aug 27 04:06:45.729016 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 268/514] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:45 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1561 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:45.761009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:45.761707 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:45.772093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.772544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.773338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.773774 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.774080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:45.775064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:45.782698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.783158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.783955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.784729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.938004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8e678de6-9d44-49ae-b588-1492dbe0338d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.167797 Aug 27 04:06:45.938623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 269/515] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:45 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:45.943957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:45.944548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:45.952431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.953206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.954253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:45.954780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:45.995997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:46.004083 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6bd8f999-e758-42ac-b853-3f969c04d98c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1187 microversion: 2.1 time: 0.247228 Aug 27 04:06:46.004642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 247/516] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:45 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1187 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:46.077751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lazy-loading 'services' on Instance uuid 715a2f59-8055-4b6e-a32f-07a45609c931 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:06:46.216487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:46.216996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:46.223057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:46.223593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:46.224369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:46.224803 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:46.283742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-09a7b4f5-8d48-48b7-9376-4422702b8456 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments/e7186d0d-3e8a-4472-a5aa-1381fd39961a" status: 202 len: 0 microversion: 2.1 time: 0.343681 Aug 27 04:06:46.284548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 270/517] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:06:45 2021] DELETE /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments/e7186d0d-3e8a-4472-a5aa-1381fd39961a => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:46.294985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:46.295984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:46.303137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:46.303608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:46.304420 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:46.304885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:46.342062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dbb34eaf-ee4b-4050-ae54-0326113495d1 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052967 Aug 27 04:06:46.344232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 271/518] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:06:46 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:06:46.369941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:46.378037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f553ee6b-dfc4-4702-a68b-bd86a0a8e11d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.165865 Aug 27 04:06:46.381838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 248/519] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:46 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:46.952101 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:46.953713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:46.961342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:46.962027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:46.963094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:46.963681 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.023388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:47.025043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:47.033876 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:47.034454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.035444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:47.035950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.132837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:47.147844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d16290f1-31a2-4993-a889-b5aff15c383e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1195 microversion: 2.1 time: 0.129390 Aug 27 04:06:47.157187 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 249/520] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:47 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1195 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:47.228059 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9527a091-d2b3-425f-a3b5-f19dfe707681 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.281401 Aug 27 04:06:47.232285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 272/521] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:46 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:47.354464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:47.356450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:47.367440 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:47.367898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.368922 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:47.369379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.400457 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:47.401521 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:47.413848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:47.417037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.419813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:47.422333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:47.432380 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-58e72cc7-452b-438b-88fa-20baad2d73cc tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082717 Aug 27 04:06:47.432951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 250/522] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:06:47 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:47.756884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:47.765313 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3e4d2ddf-cdce-45be-9070-b3c4401da16e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1318 microversion: 2.1 time: 0.370270 Aug 27 04:06:47.765891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 273/523] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:47 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:48.169375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:48.169977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:48.177462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.178247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.179524 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.180839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.243211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:48.244190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:48.250734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.251387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.252175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.252605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.297536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:48.306140 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-17d58fe2-795a-4aa7-8372-ddb7fc4c91fc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1205 microversion: 2.1 time: 0.141359 Aug 27 04:06:48.306915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 251/524] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:48 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1205 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:48.361413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e61553d4-1ed3-420d-a815-8e1dd3fcf576 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.121434 Aug 27 04:06:48.366314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 274/525] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:48 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:48.444694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:48.445596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:48.453326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.453772 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.454549 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.455004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.487817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d2d3b09b-a931-4ea8-933d-1bada783558e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047002 Aug 27 04:06:48.488404 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 252/526] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:06:48 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:06:48.783397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:48.784633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:48.791983 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.792556 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:48.793535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:48.793975 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:49.129903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:49.140226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-76bff183-4b13-41b4-aeac-3366d9c3ba64 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1508 microversion: 2.1 time: 0.362291 Aug 27 04:06:49.153219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 275/527] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:48 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1508 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:49.323679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:49.325591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:49.332012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:49.332569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:49.333401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:49.333852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:49.379574 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:49.380471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:49.388863 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:49.394004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:49.394004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:49.394004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:49.495017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1d3ffa49-db59-4593-aab7-32e4426482c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.119243 Aug 27 04:06:49.496991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 276/528] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:49 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:49.759335 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:49.767441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-50c27e11-7de4-41ca-940b-1bf4ac1531d5 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1273 microversion: 2.1 time: 0.447391 Aug 27 04:06:49.768647 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 253/529] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:49 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1273 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:50.512253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:50.514716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:50.529458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:50.531334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:50.534116 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:50.535145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:50.556269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-3f9e74f3-b62d-4d9f-a144-36e5e0fcb0ce req-fa333f5e-21ac-4264-8701-7e70df8303f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:50.587680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:06:50.587680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:06:50.627896 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-3f9e74f3-b62d-4d9f-a144-36e5e0fcb0ce req-fa333f5e-21ac-4264-8701-7e70df8303f4 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:50.631371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-3f9e74f3-b62d-4d9f-a144-36e5e0fcb0ce req-fa333f5e-21ac-4264-8701-7e70df8303f4 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:50.659729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-3f9e74f3-b62d-4d9f-a144-36e5e0fcb0ce req-fa333f5e-21ac-4264-8701-7e70df8303f4 service nova] Creating event network-changed:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:06:50.669814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-3f9e74f3-b62d-4d9f-a144-36e5e0fcb0ce req-fa333f5e-21ac-4264-8701-7e70df8303f4 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123894 Aug 27 04:06:50.671669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 254/530] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:06:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:50.694971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0824eb28-ecca-40d7-9513-0d25675f0f10 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.189160 Aug 27 04:06:50.696833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 277/531] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:50 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:50.789393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:50.792701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:50.801825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:50.803102 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:50.804478 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:50.805158 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:51.177729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:51.187301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7cf38549-f63f-4096-ad28-46dae6b2bf31 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.404146 Aug 27 04:06:51.196735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 255/532] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:50 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:51.331436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:51.332019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:51.338627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:51.339080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:51.340557 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:51.340988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:51.366103 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:06:51.716540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:51.718302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:51.732271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:51.732271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:51.732271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:51.732271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:51.894223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3c075c75-5f66-4201-8984-4e44108c005a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.188723 Aug 27 04:06:51.895019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 256/533] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:51 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:51.925524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-22adef69-2323-44a0-9d46-152d41296ecb tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 204 len: 0 microversion: 2.1 time: 0.597703 Aug 27 04:06:51.926229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 278/534] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:06:51 2021] DELETE /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:06:51.939176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:51.939978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:51.946295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:51.946892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:51.947741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:51.948247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:52.215767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:52.216859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:52.233908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:52.235257 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:52.236197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:52.236586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:52.307422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:52.316889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-645511d6-7b84-4a0a-ac30-88a2efc1ae6b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1507 microversion: 2.1 time: 0.382197 Aug 27 04:06:52.322991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 257/535] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:51 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:52.329291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd21de8a-27cc-4165-9cd6-c604795df084"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:52.330469 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:52.336612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:52.337062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:52.337845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:52.338275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:52.558384 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:52.572349 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-60c60db1-bfbd-4dbc-9b5f-516c1a1cf9ca tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.362008 Aug 27 04:06:52.573086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 279/536] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:52 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:52.908478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:52.909955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:52.945485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:52.946730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:52.947547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:52.948041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:53.110128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e2befe0c-2715-448a-99c7-a2ba7aa1d6e4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.208140 Aug 27 04:06:53.110822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 280/537] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:52 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:53.338111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:53.339856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:53.353290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:53.354148 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:53.356453 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:53.357178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:53.424724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e21fd264-aa4f-4b81-8399-f9748d041cb9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "POST /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.099392 Aug 27 04:06:53.426281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 258/538] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:06:52 2021] POST /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments => generated 194 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:53.590924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:53.592178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:53.599450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:53.600174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:53.601251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:53.602000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:53.631679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:53.640241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-63baea50-6a95-48b5-a9e1-3fcc0ce5e808 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1507 microversion: 2.1 time: 0.308329 Aug 27 04:06:53.640887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 281/539] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:53 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:53.775393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:53.784395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ecce6985-98c6-48b4-9052-35d418696c92 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.198689 Aug 27 04:06:53.785208 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 259/540] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:53 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:54.122462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:54.123493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:54.130048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:54.130271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:54.131088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:54.131527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:54.253021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7938dc97-be78-49c3-855d-ad97a87793b6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.134703 Aug 27 04:06:54.253667 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 282/541] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:54 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:06:54.657938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:54.660891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:54.667932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:54.668768 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:54.670369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:54.670861 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:54.806167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:54.809157 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:54.815860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:54.816305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:54.817082 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:54.817557 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:54.921257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:54.929828 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-80601122-4c11-470e-a7d6-dda49c5d5668 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1507 microversion: 2.1 time: 0.275751 Aug 27 04:06:54.930747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 260/542] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:54 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1507 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:55.012350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:55.021061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7f1de748-7b98-42bf-a016-07cbb697b3b1 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.221051 Aug 27 04:06:55.022067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 283/543] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:54 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:55.265799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:55.267170 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:55.273985 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:55.274647 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:55.275557 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:55.276031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:55.409746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e27b70cb-2a2e-4a12-a722-4b4b44908023 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.148330 Aug 27 04:06:55.410674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 261/544] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:55 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:55.953221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:55.954366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:55.967813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:55.968999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:55.971709 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:55.973857 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:56.043811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:56.044696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:56.053961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:56.055792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:56.060739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:56.062028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:56.302464 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:56.317200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-38553ffe-24a3-4201-a13e-841ccd9c5a7b tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1507 microversion: 2.1 time: 0.372660 Aug 27 04:06:56.317967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 284/545] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:55 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1507 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:56.408923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:56.419423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c4598ad2-049e-46ee-8c12-7738e0ed1090 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.381760 Aug 27 04:06:56.423839 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:56.425905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:56.429886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 262/546] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:56 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:56.437492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:56.438095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:56.439177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:56.440111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:56.536805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d0323390-1f19-470f-bb2d-7752a154c612 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.118366 Aug 27 04:06:56.537689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 285/547] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:56 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:57.045575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-5ed737e5-26c0-4632-8508-b4d313b4584b req-da5b1593-aef0-4168-b9a7-55b4815ad50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb527b41-c9a1-4ffd-861a-e7ed1dcd796f", "name": "network-vif-deleted", "tag": "8697a5a5-f72a-4cef-ae30-99ffc017de8e"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:57.048557 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:06:57.048557 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:06:57.056520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-5ed737e5-26c0-4632-8508-b4d313b4584b req-da5b1593-aef0-4168-b9a7-55b4815ad50e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.056978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-5ed737e5-26c0-4632-8508-b4d313b4584b req-da5b1593-aef0-4168-b9a7-55b4815ad50e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.074771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-5ed737e5-26c0-4632-8508-b4d313b4584b req-da5b1593-aef0-4168-b9a7-55b4815ad50e service nova] Creating event network-vif-deleted:8697a5a5-f72a-4cef-ae30-99ffc017de8e for instance fb527b41-c9a1-4ffd-861a-e7ed1dcd796f on hv-cinder-80475 Aug 27 04:06:57.080448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-5ed737e5-26c0-4632-8508-b4d313b4584b req-da5b1593-aef0-4168-b9a7-55b4815ad50e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038428 Aug 27 04:06:57.081985 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 263/548] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:06:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:06:57.337171 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:57.338297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:57.345607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.346173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.347081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.347808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.415290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:57.424024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-50cb1ab3-0355-437b-ab57-e8edfc4c671c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 200 len: 1292 microversion: 2.1 time: 0.091698 Aug 27 04:06:57.424915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 286/549] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:57 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:57.438422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:57.439336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:57.445798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.446252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.447068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.447506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.552525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:57.553446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:57.559889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.560560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.561516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:57.562116 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:57.683033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6cdf1a23-c46a-4f55-a397-b7a94c0c6547 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.137099 Aug 27 04:06:57.683813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 287/550] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:57 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:57.726826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:57.734971 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7dc7c796-782c-47ff-aa6c-f0280352fe0d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.301678 Aug 27 04:06:57.739959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 264/551] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:57 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:58.441780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:58.442590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: fb527b41-c9a1-4ffd-861a-e7ed1dcd796f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:58.449791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.450238 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.451335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.452210 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.469447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] HTTP exception thrown: Instance fb527b41-c9a1-4ffd-861a-e7ed1dcd796f could not be found. Aug 27 04:06:58.470041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Returning 404 to user: Instance fb527b41-c9a1-4ffd-861a-e7ed1dcd796f could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:06:58.471020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b68cce66-5356-4805-8e6f-362f54276bc9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f" status: 404 len: 111 microversion: 2.1 time: 0.033350 Aug 27 04:06:58.471582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 288/552] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:58 2021] GET /compute/v2.1/servers/fb527b41-c9a1-4ffd-861a-e7ed1dcd796f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:06:58.482722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:58.483385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:58.491064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.491741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.492873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.493351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.525423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:06:58.696403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:58.699926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:58.704275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.704996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.705969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.706628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.840511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aa7326f3-f3fa-47dc-b38e-7a65888a6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.148671 Aug 27 04:06:58.845895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 289/553] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:58 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:06:58.856801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:58.868403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:58.881108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.881108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.881108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.886678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.892930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-18a417cb-25fe-45b8-ad9b-6f4e83241fac tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "DELETE /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 204 len: 0 microversion: 2.1 time: 0.416101 Aug 27 04:06:58.898188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 265/554] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:06:58 2021] DELETE /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:06:58.908566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:06:58.914717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:58.947337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.949989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:58.958834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:58.959502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:59.480882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:59.488804 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6ca4b0fe-027f-4ac9-bfb5-db501a2a5f06 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.645817 Aug 27 04:06:59.489669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 290/555] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:58 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:06:59.533288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:06:59.544374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-67552e11-12fb-4889-bc0d-b422ce378501 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.644584 Aug 27 04:06:59.545212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 266/556] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:06:58 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:06:59.856348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:06:59.857837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:06:59.864646 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:59.865357 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:59.866321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:06:59.866966 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:06:59.999703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e9ebe67e-e25a-4088-b427-14d4d97010dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.148935 Aug 27 04:07:00.000369 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 291/557] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:06:59 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:00.507992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:00.508602 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:00.514628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:00.515088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:00.515879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:00.516326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:00.565249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:00.566035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:00.572373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:00.572823 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:00.573740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:00.574322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:00.900205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:00.909617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:00.913791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ae1c59af-8bed-4b4b-859f-0c2b87b9b6b3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.409310 Aug 27 04:07:00.916891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 267/558] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:00 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:00.918177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4ecbb8a3-7032-41ce-9d5f-aafa7b2698f7 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.358528 Aug 27 04:07:00.920392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 292/559] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:00 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:01.015362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:01.017784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:01.045108 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:01.046582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:01.050633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:01.051942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:01.189304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a6d51454-1b9d-475a-ba30-56c6a689f487 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 28685 microversion: 2.20 time: 0.179925 Aug 27 04:07:01.189966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 268/560] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:01 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 28685 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:07:01.940273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:01.940931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:01.941570 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:01.943452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:01.952762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:01.953287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:01.955230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:01.955863 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:01.962786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:01.964570 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:01.966152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:01.967364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.184099 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:02.187481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:02.193481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d16325de-ce48-4735-b610-34cff3dbb04a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.261175 Aug 27 04:07:02.196944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ac1b623b-b6e6-4ba3-9c6c-9611cc4cd50a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.260305 Aug 27 04:07:02.197655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 269/561] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:01 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:02.203122 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:02.203728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 293/562] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:01 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:02.204040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:02.210048 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:02.210496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.211331 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:02.211764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.332043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-89191e07-16ae-448a-87c0-d46694a9b69e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 29523 microversion: 2.20 time: 0.133177 Aug 27 04:07:02.333889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 270/563] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:02 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 29523 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:02.388895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:02.390032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:02.396532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:02.396988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.397774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:02.398208 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.517913 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'services' on Instance uuid f022fee3-a0a6-49ea-bd1f-283627d16159 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:02.811493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-79c1015a-9f4f-481f-9ee2-fe9eddfe868d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments/fd21de8a-27cc-4165-9cd6-c604795df084" status: 202 len: 0 microversion: 2.1 time: 0.426919 Aug 27 04:07:02.813312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 294/564] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:07:02 2021] DELETE /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments/fd21de8a-27cc-4165-9cd6-c604795df084 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:07:02.828129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:02.834461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:02.863600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:02.863881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.864835 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:02.865277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:02.946660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dac274ce-3e89-4753-95e9-3af869c66a49 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127658 Aug 27 04:07:02.949128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 271/565] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:07:02 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:03.218605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:03.219842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:03.221904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:03.240023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:03.250683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.251468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.252270 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.253112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.284117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.284664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.285549 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.286068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.595825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:03.607921 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-29fdf5c4-1a79-4c0e-b135-f6b16a5c6d1a tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.396149 Aug 27 04:07:03.609218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 295/566] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:03 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:03.609660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:03.618426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d1e1d022-1d3e-4da4-844d-93066dc612fe tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.405249 Aug 27 04:07:03.619494 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 272/567] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:03 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:03.624084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:03.625383 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:03.636835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.638233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.639781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.640454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.915743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c407ce52-0249-404a-8ac5-0add83666b6e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 30816 microversion: 2.20 time: 0.303455 Aug 27 04:07:03.916397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 296/568] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:03 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 30816 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:03.961670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:03.962841 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:03.977390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.978715 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:03.980219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:03.980812 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:04.052303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9fa91814-8b06-460b-8581-8f6e47b290b0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094862 Aug 27 04:07:04.053581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 273/569] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:07:03 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:04.629368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:04.630785 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:04.636797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:04.637591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:04.644798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:04.657179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:04.658401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:04.658880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:04.671301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:04.671301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:04.671757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:04.671972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:05.061845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:05.071650 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0454e562-ade2-4ee0-b288-118e248d4565 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.438906 Aug 27 04:07:05.071794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:05.072236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 274/570] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:04 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:05.081871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c965b14e-ea55-47b1-8483-ddb9505750d9 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.458780 Aug 27 04:07:05.082883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 297/571] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:04 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:05.087439 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:05.088178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:05.088344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:05.089596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:05.096027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:05.096719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:05.097651 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:05.098737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:05.101789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:05.102244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:05.107805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:05.111303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:05.158672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3987ec66-0bff-4ce5-b984-057fad61b34e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074287 Aug 27 04:07:05.159439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 298/572] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:07:05 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:07:05.257683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5e86cc66-757e-4608-a0ac-9d0e23eec40d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 31928 microversion: 2.20 time: 0.183981 Aug 27 04:07:05.261885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 275/573] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:05 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 31928 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:06.089561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:06.090342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:06.097193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.097635 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.098451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.098916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.101204 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:06.102282 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:06.110261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.110787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.111562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.111993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.303898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:06.313568 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5043f15b-fadc-462d-b37d-18497f96d0ae tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.228281 Aug 27 04:07:06.314194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 299/574] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:06 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:06.319136 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:06.320428 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:06.327056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.327219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:06.327493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.328282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.328742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.335362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-84b4f700-27a9-4d85-9587-f573f7d2ba7e tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.239067 Aug 27 04:07:06.346741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 276/575] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:06 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:06.581712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:06.582528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:06.589820 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.590603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.591627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:06.592272 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:06.595995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0bd7bce1-3920-4a09-ae0b-16bd59746449 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 33112 microversion: 2.20 time: 0.280294 Aug 27 04:07:06.602998 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 300/576] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:06 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 33112 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:06.642336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:07:07.036367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-75ba3838-5585-42cf-b9ea-b20e9aa982dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 204 len: 0 microversion: 2.1 time: 0.457639 Aug 27 04:07:07.039947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 277/577] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:07:06 2021] DELETE /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:07.050307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-ca60116a-9882-46b0-9877-52876815b76d req-394144f8-8ad9-44f6-86c4-655652d6cff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "name": "network-vif-plugged", "status": "completed", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:07.050691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:07.056667 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:07.056667 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:07.059596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:07.070449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.071209 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.072701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.073741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.080252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-ca60116a-9882-46b0-9877-52876815b76d req-394144f8-8ad9-44f6-86c4-655652d6cff1 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.080717 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-ca60116a-9882-46b0-9877-52876815b76d req-394144f8-8ad9-44f6-86c4-655652d6cff1 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.104213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-ca60116a-9882-46b0-9877-52876815b76d req-394144f8-8ad9-44f6-86c4-655652d6cff1 service nova] Creating event network-vif-plugged:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:07:07.112345 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-ca60116a-9882-46b0-9877-52876815b76d req-394144f8-8ad9-44f6-86c4-655652d6cff1 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080157 Aug 27 04:07:07.113500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 301/578] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:07.265261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:07.278958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-92107c4a-d6ea-4ff7-8869-54f0f309d1c2 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1514 microversion: 2.1 time: 0.234844 Aug 27 04:07:07.285418 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 278/579] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:07 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1514 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:07.334996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:07.336203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:07.344812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.345268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.346137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.346589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.357153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:07.359336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:07.372915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.373506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.375480 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.377144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.738349 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:07.747084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7f3d6cdf-4600-49b0-84b2-0596975a67cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.419617 Aug 27 04:07:07.747908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 302/580] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:07 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:07.751317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:07.755914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:07.757248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:07.772614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a3aec265-761c-497f-beeb-1ca938bde391 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1521 microversion: 2.1 time: 0.406973 Aug 27 04:07:07.772614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 279/581] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:07 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1521 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:07.773007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.773007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.773007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:07.773007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:07.908391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8939a50e-fcaf-4811-8390-02b624f4e1be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 33769 microversion: 2.20 time: 0.158783 Aug 27 04:07:07.909911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 303/582] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:07 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 33769 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:08.299875 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:08.301897 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:08.326699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.326699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.327356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.328242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.371500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-599f5142-203b-4ecb-a10d-86344bdd4b53 req-2b58f807-a434-4952-a726-88c5b20753b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "715a2f59-8055-4b6e-a32f-07a45609c931", "name": "network-vif-deleted", "tag": "dcd7a2b9-30fd-43d0-85c6-38a70773fb11"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:08.373852 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:08.373852 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:08.381915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-599f5142-203b-4ecb-a10d-86344bdd4b53 req-2b58f807-a434-4952-a726-88c5b20753b9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.382729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-599f5142-203b-4ecb-a10d-86344bdd4b53 req-2b58f807-a434-4952-a726-88c5b20753b9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.395892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-599f5142-203b-4ecb-a10d-86344bdd4b53 req-2b58f807-a434-4952-a726-88c5b20753b9 service nova] Creating event network-vif-deleted:dcd7a2b9-30fd-43d0-85c6-38a70773fb11 for instance 715a2f59-8055-4b6e-a32f-07a45609c931 on hv-cinder-80475 Aug 27 04:07:08.401132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-599f5142-203b-4ecb-a10d-86344bdd4b53 req-2b58f807-a434-4952-a726-88c5b20753b9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Aug 27 04:07:08.402117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 304/583] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:07:08.468347 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:08.477384 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cb5175aa-c850-46a6-8bcb-bb1ddd958f1d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1514 microversion: 2.1 time: 0.184639 Aug 27 04:07:08.478128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 280/584] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:08 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1514 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:08.765599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:08.765998 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:08.779825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:08.780429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:08.782477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.783391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.784377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.784993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.788770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.789230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.790032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.790468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.869069 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:08.879291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2dc25642-6ce7-4201-bc5b-3c2b2cd40b60 tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1479 microversion: 2.1 time: 0.103782 Aug 27 04:07:08.888645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 281/585] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:08 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1479 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:08.929482 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:08.930779 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:08.939509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.940071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:08.942785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:08.943354 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:09.080762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:09.088456 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e8895fc9-413d-41f0-a03a-2d2fbe2cde11 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.328010 Aug 27 04:07:09.093334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 305/586] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:08 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:09.321746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a44eba90-ea24-4ba0-b6dd-06c4315fde7b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 35415 microversion: 2.20 time: 0.402446 Aug 27 04:07:09.324017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 282/587] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:08 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 35415 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:09.516562 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:09.517249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:09.524047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:09.524523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:09.525292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:09.525814 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:09.781499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:09.781499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-304fdd6a-dd7c-4951-b2ec-e27c666fbe80 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1514 microversion: 2.1 time: 0.180787 Aug 27 04:07:09.781499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 306/588] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:09 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:09.896835 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:09.897893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:09.906167 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:09.906789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:09.907589 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:09.908031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:09.939390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:09.939839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:09.940294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lazy-loading 'fault' on Instance uuid 715a2f59-8055-4b6e-a32f-07a45609c931 {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:09.980859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09ee35f66a4c4cb987f20990e974961f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5030fe8a997e416683658c321efaef5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:09.988034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-af5bb1d7-24d3-4960-b05c-5a5fa0c4889c tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 200 len: 1311 microversion: 2.1 time: 0.095407 Aug 27 04:07:09.988594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 283/589] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:09 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:10.105058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:10.105721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:10.111522 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:10.111971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:10.112745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:10.113178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:10.235792 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:10.243017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-25ff8b2a-43de-4a3a-9767-1aee62fd90f6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.141660 Aug 27 04:07:10.243578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 307/590] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:10 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:10.334726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:10.335780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:10.342163 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:10.343065 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:10.344126 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:10.345058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:10.486448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fa9029c1-d6e1-4955-b991-d20066c56e21 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 36281 microversion: 2.20 time: 0.155140 Aug 27 04:07:10.488676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 284/591] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:10 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 36281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:10.754122 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:10.755176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:10.761775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:10.762433 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:10.763292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:10.763789 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:10.927150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:10.936558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3006d4f5-adca-4482-9fef-482a39bb059c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1514 microversion: 2.1 time: 0.185660 Aug 27 04:07:10.947627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 308/592] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:10 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:11.007203 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:11.007915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] [instance: 715a2f59-8055-4b6e-a32f-07a45609c931] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:11.017427 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.017427 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.023736 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.023736 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.037346 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] HTTP exception thrown: Instance 715a2f59-8055-4b6e-a32f-07a45609c931 could not be found. Aug 27 04:07:11.038040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] Returning 404 to user: Instance 715a2f59-8055-4b6e-a32f-07a45609c931 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:11.039009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-56ae4f05-a824-4018-b69f-c72f39c15aef tempest-ServerRescueNegativeTestJSON-546852757 tempest-ServerRescueNegativeTestJSON-546852757-project] 10.222.0.73 "GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931" status: 404 len: 111 microversion: 2.1 time: 0.037590 Aug 27 04:07:11.039888 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 285/593] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:11 2021] GET /compute/v2.1/servers/715a2f59-8055-4b6e-a32f-07a45609c931 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:11.260026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:11.261588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:11.270351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.271246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.272267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.272919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.499398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:11.500317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:11.513849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.513849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.514516 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.515141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.549773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:11.559973 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3c5868bf-a047-4389-8fe4-e23f5deab777 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1261 microversion: 2.1 time: 0.303836 Aug 27 04:07:11.561715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 309/594] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:11 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1261 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:11.804604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7ecc1ae1-9725-4c61-9d29-6bcf9e734412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 37792 microversion: 2.20 time: 0.309323 Aug 27 04:07:11.812058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 286/595] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:11 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 37792 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:07:11.958659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:11.960765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:11.968826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.970112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:11.973645 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:11.974383 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:12.278297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:12.297220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-508eb4e0-0904-46d9-a3be-d9c9462daf88 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1514 microversion: 2.1 time: 0.345566 Aug 27 04:07:12.307140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 310/596] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:11 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:12.577806 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:12.578723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:12.593803 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:12.594539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:12.595540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:12.596137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:12.816871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:12.817953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:12.825290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:12.825741 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:12.826534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:12.827012 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:12.928004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:12.936960 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5b8f9f34-d7cf-4fff-bbf8-7da8df5829db tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1446 microversion: 2.1 time: 0.363210 Aug 27 04:07:12.937834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 287/597] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:12 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1446 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:12.946147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b177b9fd-e53a-4f6e-84e2-8b31289d1406 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 38216 microversion: 2.20 time: 0.133010 Aug 27 04:07:12.952458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 311/598] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:12 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 38216 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:07:12.956781 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:12.957830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:12.966185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:12.966962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:12.967773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:12.968212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:13.200348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-7ed3b18e-31bf-426a-ad4f-27ae93664a05 req-1ed666b0-c092-4edc-9692-d93facb1ee22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f022fee3-a0a6-49ea-bd1f-283627d16159", "name": "network-vif-deleted", "tag": "c7b390d3-307b-4783-8110-7fc1b14d1e6e"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:13.207780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:13.207780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:13.210656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-7ed3b18e-31bf-426a-ad4f-27ae93664a05 req-1ed666b0-c092-4edc-9692-d93facb1ee22 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:13.211402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-7ed3b18e-31bf-426a-ad4f-27ae93664a05 req-1ed666b0-c092-4edc-9692-d93facb1ee22 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:13.226308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-7ed3b18e-31bf-426a-ad4f-27ae93664a05 req-1ed666b0-c092-4edc-9692-d93facb1ee22 service nova] Creating event network-vif-deleted:c7b390d3-307b-4783-8110-7fc1b14d1e6e for instance f022fee3-a0a6-49ea-bd1f-283627d16159 on hv-cinder-80475 Aug 27 04:07:13.232368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-7ed3b18e-31bf-426a-ad4f-27ae93664a05 req-1ed666b0-c092-4edc-9692-d93facb1ee22 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046977 Aug 27 04:07:13.233552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 312/599] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:13.315499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:13.316610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:13.334708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:13.348864 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:13.349803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:13.350321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:13.518353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:13.518739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:13.525700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1d738eaa-5617-429d-93a9-4ae960b1299a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1446 microversion: 2.1 time: 0.572739 Aug 27 04:07:13.527307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 288/600] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:12 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1446 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:13.528538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a8d5e311-6345-4cc0-9b08-103cd6452a01 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1472 microversion: 2.1 time: 0.217181 Aug 27 04:07:13.537430 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 313/601] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:13 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1472 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:13.960532 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:13.962383 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:13.970779 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:13.972341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:13.973370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:13.974019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:14.107923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b0be7ceb-083b-4744-a4b6-9c71a471130b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 38216 microversion: 2.20 time: 0.152095 Aug 27 04:07:14.109124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 289/602] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:13 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 38216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:14.544755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:14.545380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:14.553392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:14.553848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:14.554678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:14.555272 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:14.637283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:14.637738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:14.638207 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'fault' on Instance uuid f022fee3-a0a6-49ea-bd1f-283627d16159 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:14.811385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:14.824932 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-46fc5626-c59e-43b8-9103-4587418f52f9 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 200 len: 1308 microversion: 2.1 time: 0.280294 Aug 27 04:07:14.826063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 314/603] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:14 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 1308 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:15.133143 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:15.134154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:15.147050 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:15.147742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:15.149177 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:15.150168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:15.305791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9325bf7c-083d-4d86-adb3-7457e59481d0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 38216 microversion: 2.20 time: 0.181752 Aug 27 04:07:15.307131 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 290/604] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:15 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 38216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:15.345227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8697ec53-2c7b-4f76-abf4-22b0bc1cfa35 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Action: 'create', calling method: .version_select at 0x7f538e7743a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1358440251"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:15.366880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-8697ec53-2c7b-4f76-abf4-22b0bc1cfa35 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Getting quotas for project 28d44e8045c24df28323402022ac9228. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:07:15.371591 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-8697ec53-2c7b-4f76-abf4-22b0bc1cfa35 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Getting quotas for user ee2fe0b619014522a8bd2bcaf7378660 and project 28d44e8045c24df28323402022ac9228. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:07:15.546601 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-8697ec53-2c7b-4f76-abf4-22b0bc1cfa35 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Getting quotas for project 28d44e8045c24df28323402022ac9228. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:07:15.550915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-8697ec53-2c7b-4f76-abf4-22b0bc1cfa35 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Getting quotas for user ee2fe0b619014522a8bd2bcaf7378660 and project 28d44e8045c24df28323402022ac9228. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:07:15.564506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8697ec53-2c7b-4f76-abf4-22b0bc1cfa35 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.223192 Aug 27 04:07:15.574701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 315/605] 10.222.0.73 () {60 vars in 1158 bytes} [Fri Aug 27 04:07:15 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:15.617102 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1037003342", "imageRef": "c2c7ca01-f2c4-4624-9831-ee9a15204a9a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1358440251", "networks": [{"uuid": "bb0362c5-58ba-43c2-8e2e-e8b684b65d1d"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:15.684296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] validate_networks() for [('bb0362c5-58ba-43c2-8e2e-e8b684b65d1d', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:07:15.850239 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:15.851334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: f022fee3-a0a6-49ea-bd1f-283627d16159] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:15.862712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:15.863343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:15.864290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:15.864982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:15.890908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] HTTP exception thrown: Instance f022fee3-a0a6-49ea-bd1f-283627d16159 could not be found. Aug 27 04:07:15.891512 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Returning 404 to user: Instance f022fee3-a0a6-49ea-bd1f-283627d16159 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:15.892559 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f0aa88f3-059c-47d6-8126-1e54f332285b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159" status: 404 len: 111 microversion: 2.1 time: 0.054230 Aug 27 04:07:15.893610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 316/606] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:15 2021] GET /compute/v2.1/servers/f022fee3-a0a6-49ea-bd1f-283627d16159 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:07:16.321076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:16.322277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:16.332588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.333282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.334510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.335373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.458432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a8413a3c-3ab8-4827-aac9-4d4160ed5db2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 200 len: 38357 microversion: 2.20 time: 0.141549 Aug 27 04:07:16.466543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 317/607] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:16 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 38357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:16.473506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:16.474518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:16.498914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.499399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.500365 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.501173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.527083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3cb7c914-f258-4613-83f1-a6bbba7a79ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/ips" status: 200 len: 150 microversion: 2.20 time: 0.058542 Aug 27 04:07:16.527669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 318/608] 10.222.0.73 () {60 vars in 1289 bytes} [Fri Aug 27 04:07:16 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:07:16.534628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-b0e00e38-6135-4cc7-a972-6a820faa8ee3 req-2a418f18-78bc-4391-920f-09803c71eef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:16.534628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:16.534628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:16.541408 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-b0e00e38-6135-4cc7-a972-6a820faa8ee3 req-2a418f18-78bc-4391-920f-09803c71eef9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.542796 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-b0e00e38-6135-4cc7-a972-6a820faa8ee3 req-2a418f18-78bc-4391-920f-09803c71eef9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.564856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-b0e00e38-6135-4cc7-a972-6a820faa8ee3 req-2a418f18-78bc-4391-920f-09803c71eef9 service nova] Creating event network-changed:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:07:16.571303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-b0e00e38-6135-4cc7-a972-6a820faa8ee3 req-2a418f18-78bc-4391-920f-09803c71eef9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041933 Aug 27 04:07:16.572231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 319/609] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:16.880975 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:07:16.882700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:07:16.883645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:07:16.884291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:07:16.885173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:07:16.925711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.926106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.927153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:16.927749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:16.955247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Getting quotas for project 28d44e8045c24df28323402022ac9228. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:07:16.959814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Getting quotas for user ee2fe0b619014522a8bd2bcaf7378660 and project 28d44e8045c24df28323402022ac9228. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:07:16.972889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:07:16.975292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c7ca01-f2c4-4624-9831-ee9a15204a9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:07:17.115004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-045e467c-a49b-4b8a-809c-0ac2c434f882 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.502208 Aug 27 04:07:17.116295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 291/610] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:07:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:07:17.127081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9f21b111-bdad-44cb-8288-5315bfc724c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:17.128075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9f21b111-bdad-44cb-8288-5315bfc724c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:17.263222 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9f21b111-bdad-44cb-8288-5315bfc724c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:17.284704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9f21b111-bdad-44cb-8288-5315bfc724c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1259 microversion: 2.1 time: 0.161781 Aug 27 04:07:17.299228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 320/611] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:17 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:18.305567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:18.306771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:18.314679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:18.315615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:18.316600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:18.317269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:18.335920 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:18.337148 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:18.345938 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:18.346397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:18.347212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:18.347734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:18.378121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:07:18.387588 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:18.394871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f08cd183-c0ec-4f15-ac01-e66667362a16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1263 microversion: 2.1 time: 0.093667 Aug 27 04:07:18.404257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 292/612] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:18 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:18.793192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ac774c16-e39e-43b0-bbaf-4499761a0ff6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 204 len: 0 microversion: 2.1 time: 0.461195 Aug 27 04:07:18.794204 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 321/613] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:07:18 2021] DELETE /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:07:18.804773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:18.805392 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:18.815127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:18.815127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:18.815324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:18.815633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:18.946893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:18.954873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-de5a444f-06b6-41b1-af38-d6e45e3cdb83 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.155027 Aug 27 04:07:18.965885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 293/614] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:18 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:19.229626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bdd9c04e-ea58-4d04-bd3b-e57f560ebbac tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Action: 'create', calling method: .version_select at 0x7f538e7ac4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1869679465", "metadata": {"Type": "work"}}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:19.411681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:19.412285 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:19.418047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:19.418521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:19.419317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:19.419747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:19.480024 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:19.487766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6171a08b-be0b-43d6-9c71-a7f80d431874 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1311 microversion: 2.1 time: 0.079846 Aug 27 04:07:19.488501 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 294/615] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:19 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1311 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:19.973708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:19.974245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:19.981226 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:19.982161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:19.982450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:19.982912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:20.127555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bdd9c04e-ea58-4d04-bd3b-e57f560ebbac tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.049564 Aug 27 04:07:20.127555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 322/616] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Aug 27 04:07:19 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1051 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 27 04:07:20.141649 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-52ab793b-b057-4221-af10-9f66ee57ccdb tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538e78a280>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:20.210760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-52ab793b-b057-4221-af10-9f66ee57ccdb tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 200 len: 353 microversion: 2.1 time: 0.075813 Aug 27 04:07:20.217422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 323/617] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:07:20 2021] GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:20.242344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:20.250134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7da7ac67-4595-48e9-9d63-0ea8c7c09d2f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.280424 Aug 27 04:07:20.250727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 295/618] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:19 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:20.505822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:20.506592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:20.513242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:20.513726 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:20.514511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:20.515054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:20.572260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:20.573871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:20.580075 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:20.580528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:20.581389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:20.581859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:20.608116 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lazy-loading 'flavor' on Instance uuid eb257852-e7be-425c-b86c-f65f49093cbf {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:20.609859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:20.623311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-11c7cca0-b7b6-4972-ac66-dda7b3d648da tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1317 microversion: 2.1 time: 0.121691 Aug 27 04:07:20.623881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 324/619] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:20 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1317 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:21.227541 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8640dbe5-b956-4ec7-8cb6-04b24b2db2be tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538e77c940>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:21.305036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ce6486ef-e812-4bb6-b2ab-71ac109a64eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 202 len: 0 microversion: 2.20 time: 0.741804 Aug 27 04:07:21.305679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 296/620] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:07:20 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:07:21.317499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:21.321460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8640dbe5-b956-4ec7-8cb6-04b24b2db2be tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 200 len: 353 microversion: 2.1 time: 0.098651 Aug 27 04:07:21.323101 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 325/621] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:07:21 2021] GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:21.324775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:21.328444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:21.329152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:21.337643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:21.342029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:21.342175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:21.342175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:21.342175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:21.345004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:21.345862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:21.346504 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:21.596465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:21.608590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:21.610592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:21.611248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:21.611995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c8015964-caa5-4b45-8bcc-0eb5dd36e5e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.287337 Aug 27 04:07:21.612759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 326/622] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:21 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:21.629204 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d0be9399-bb04-4287-af48-86049a60b440 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.322080 Aug 27 04:07:21.629785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 297/623] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:21 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:21.648531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:21.649137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:21.655867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:21.656396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:21.657250 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:21.657976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:21.802477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:21.813697 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d39a2d10-9a72-4248-9b53-9ac4c9645e31 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.168977 Aug 27 04:07:21.814271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 327/624] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:21 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:22.337240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-283e3d1d-6983-4956-ae1a-37b56e02e1d8 tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538f0dc670>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.389672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-283e3d1d-6983-4956-ae1a-37b56e02e1d8 tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 200 len: 354 microversion: 2.1 time: 0.056129 Aug 27 04:07:22.390259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 298/625] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:07:22 2021] GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:22.401278 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-924c64fe-91f5-4a2e-bdc4-8bc4cd57b658 tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538e78a280>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.464590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-924c64fe-91f5-4a2e-bdc4-8bc4cd57b658 tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 200 len: 354 microversion: 2.1 time: 0.066971 Aug 27 04:07:22.465157 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 328/626] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:07:22 2021] GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:22.481297 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-37c54e48-4fa4-46f7-a225-0276cc65351d tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538f087280>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.630716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.631322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:22.638194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:22.638673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:22.639442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:22.639878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:22.734433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-37c54e48-4fa4-46f7-a225-0276cc65351d tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 202 len: 0 microversion: 2.1 time: 0.256643 Aug 27 04:07:22.735538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 299/627] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Aug 27 04:07:22 2021] DELETE /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:07:22.743033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.743639 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:22.756865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:22.757318 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:22.758149 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:22.758589 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:22.766000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:22.792896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:22.794899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:22.796585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e44146d2-1149-4ef9-91b3-483fd9a49810 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.169735 Aug 27 04:07:22.797382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 329/628] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:22 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:22.812429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aa9da870-17f7-40db-b8c0-50bc5745bd9c tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538e6d5280>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.887850 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aa9da870-17f7-40db-b8c0-50bc5745bd9c tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 200 len: 353 microversion: 2.1 time: 0.088568 Aug 27 04:07:22.893362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 330/629] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:07:22 2021] GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:22.894513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:22.894928 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:22.901043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:22.901510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:22.902471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:22.902946 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:22.928745 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:22.937362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a91b64fd-efcb-41d6-87c0-38400a031f72 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.197822 Aug 27 04:07:22.937949 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 300/630] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:22 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:23.051099 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:23.058809 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-859d53e4-8ac6-4c2a-aefb-8edd7df1fb6c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.168988 Aug 27 04:07:23.059383 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 331/631] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:22 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:23.821102 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:23.821655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:23.828465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:23.828911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:23.829689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:23.830112 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:23.901475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-79545824-d32e-4d16-9a8b-5ac60c4b281b tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Calling method '.version_select at 0x7f538e97b550>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:23.941981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-79545824-d32e-4d16-9a8b-5ac60c4b281b tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] HTTP exception thrown: Volume 74a8be08-8e36-45db-b80e-32c4f2613123 could not be found. Aug 27 04:07:23.942684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-79545824-d32e-4d16-9a8b-5ac60c4b281b tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] Returning 404 to user: Volume 74a8be08-8e36-45db-b80e-32c4f2613123 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:23.943554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-79545824-d32e-4d16-9a8b-5ac60c4b281b tempest-VolumesGetTestJSON-1758474087 tempest-VolumesGetTestJSON-1758474087-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123" status: 404 len: 109 microversion: 2.1 time: 0.046418 Aug 27 04:07:23.944105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 332/632] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:07:23 2021] GET /compute/v2.1/os-volumes/74a8be08-8e36-45db-b80e-32c4f2613123 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:23.953513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:23.954503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:23.967816 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:23.968240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:23.969039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:23.969482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:24.005631 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:24.020578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:24.024206 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:24.027568 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f1260821-77b7-415b-849c-9215f69e27d3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.213576 Aug 27 04:07:24.029222 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 301/633] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:23 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:24.076225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:24.077825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:24.085213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:24.085933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:24.086923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:24.087515 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:24.220490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:24.231095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fdd4e2ff-4c5e-477d-953c-38f4e5048174 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.281125 Aug 27 04:07:24.231752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 333/634] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:23 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:24.288509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:24.297179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6082eb96-4b1f-412b-9a81-6fe24a71bc9a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.225077 Aug 27 04:07:24.298139 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 302/635] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:24 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:24.917194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-36dfc695-db1f-42ec-9288-0b7033f1da8b req-e6fcf113-0887-44f7-8614-b2ddef4de65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8372e50f-df43-4829-b2c7-7d1a9334f817", "name": "network-vif-unplugged", "status": "completed", "tag": "e27b77a5-6aea-4f02-b303-64570873e3a4"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:24.919584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:24.919584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:24.928535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-36dfc695-db1f-42ec-9288-0b7033f1da8b req-e6fcf113-0887-44f7-8614-b2ddef4de65f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:24.929056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-36dfc695-db1f-42ec-9288-0b7033f1da8b req-e6fcf113-0887-44f7-8614-b2ddef4de65f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:24.941925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-36dfc695-db1f-42ec-9288-0b7033f1da8b req-e6fcf113-0887-44f7-8614-b2ddef4de65f service nova] Creating event network-vif-unplugged:e27b77a5-6aea-4f02-b303-64570873e3a4 for instance 8372e50f-df43-4829-b2c7-7d1a9334f817 on hv-cinder-80475 Aug 27 04:07:24.947368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-36dfc695-db1f-42ec-9288-0b7033f1da8b req-e6fcf113-0887-44f7-8614-b2ddef4de65f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034705 Aug 27 04:07:24.948730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 334/636] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:25.051162 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:25.052439 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:25.061570 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:25.062229 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:25.063403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:25.064031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:25.249459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:25.250261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:25.262115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:25.267067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:25.269315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:25.269789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:25.270957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:25.286673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:25.291010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:25.293078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-420c7fb5-9b4f-48dd-9bfe-fd9e15f4465b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.248943 Aug 27 04:07:25.294021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 303/637] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:25 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:25.314274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:25.315601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:25.322348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:25.333533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:25.335210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:25.335817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:25.453860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:25.477102 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dc96ef33-a8a1-47ca-ad22-b5d6951524f7 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.232497 Aug 27 04:07:25.477795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 335/638] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:25 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:25.502465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:25.519299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2d9b106a-5581-443e-9788-a2366ca56e4e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.207645 Aug 27 04:07:25.520585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 304/639] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:25 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:26.312155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:26.312892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:26.323953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:26.324404 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:26.325203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:26.325634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:26.484850 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:26.492848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:26.493332 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:26.493966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:26.494343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:26.496338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8708df4f-d3a8-4e85-add7-a6379012738b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.188129 Aug 27 04:07:26.497218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 336/640] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:26 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:26.501624 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:26.502081 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:26.502899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:26.503336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:26.540815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:26.541993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:26.553965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:26.554584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:26.555472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:26.556367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:26.716581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:26.724107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-020195f1-e182-44ab-b406-5800cdfb91f6 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.234357 Aug 27 04:07:26.724687 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 305/641] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:26 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:26.738395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:26.746949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ddd1ddc7-c407-43ff-814f-33424856b455 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.211058 Aug 27 04:07:26.747622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 337/642] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:26 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:27.515439 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:27.516048 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:27.521876 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:27.522375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:27.523196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:27.523740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:27.654925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:27.662981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:27.664493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:27.665658 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-062b3c60-2f1f-4952-80a2-adf7e48c9597 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.154484 Aug 27 04:07:27.666220 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 306/643] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:27 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:27.741074 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:27.741826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:27.748996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:27.749458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:27.750273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:27.750749 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:27.763912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:27.764520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:27.770210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:27.771689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:27.771689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:27.771901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:27.964262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:27.974827 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-de4ca57d-a112-4b74-bc0e-bc05c987d1dd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.236602 Aug 27 04:07:27.977748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 338/644] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:27 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:27.997241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:28.003817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8c14b455-fbbd-4e2a-9d44-ab6739a558d1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.244156 Aug 27 04:07:28.013526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 307/645] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:27 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:28.223270 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-122884313", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:28.298379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.network.neutron [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] validate_networks() for None {{(pid=108986) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:07:28.596077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Flavor limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:07:28.596505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Image limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:07:28.596984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Flavor pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:07:28.597397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Image pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:07:28.597812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:07:28.615866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:28.616956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:28.618899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:28.620091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:28.645777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Getting quotas for project 769d70d40946487c899a78bcec6dca8f. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:07:28.650131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Getting quotas for user 7037ec4eba3d404487514e3bee56a21e and project 769d70d40946487c899a78bcec6dca8f. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:07:28.663330 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Going to run 1 instances... {{(pid=108986) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:07:28.666070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:07:28.686798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:28.687570 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:28.695797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:28.696251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:28.697036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:28.702813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:28.842653 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:28.851199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:28.852950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:28.854462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cb1ab773-98df-4f50-b1a0-34cb4424e23e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.173472 Aug 27 04:07:28.855433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 308/646] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:28 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:28.890401 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-45d43aae-3c5f-4808-a488-52868866ee3e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670734 Aug 27 04:07:28.892024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 339/647] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:07:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:07:28.902810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7753214c-1f59-409a-9217-af575e6af5d4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:28.903721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7753214c-1f59-409a-9217-af575e6af5d4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:28.969678 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7753214c-1f59-409a-9217-af575e6af5d4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:28.979700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7753214c-1f59-409a-9217-af575e6af5d4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1214 microversion: 2.1 time: 0.081671 Aug 27 04:07:28.989293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 309/648] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:28 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:28.997459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:29.000653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:29.006674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:29.007130 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:29.007928 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:29.008564 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:29.022281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:29.022938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:29.030978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:29.032132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:29.033241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:29.033690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:29.215279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:29.230800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1976b9ad-74e2-4c54-9c16-d20f322d1aa5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.235741 Aug 27 04:07:29.230800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 340/649] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:28 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:29.253763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:29.265970 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8cdf4463-7881-4cd7-afdc-c9418f327c77 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.244890 Aug 27 04:07:29.265970 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 310/650] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:29 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:29.874041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:29.874725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:29.881267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:29.881819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:29.882759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:29.883277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:29.997371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-af939dd7-e08b-496a-acff-5334fe7838e4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:29.998721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-af939dd7-e08b-496a-acff-5334fe7838e4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:30.011097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.020355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.021848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.023006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-68b96795-cb12-4e6a-aaa4-550c80801405 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.152843 Aug 27 04:07:30.023923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 341/651] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:29 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:30.058388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-af939dd7-e08b-496a-acff-5334fe7838e4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.061645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-af939dd7-e08b-496a-acff-5334fe7838e4 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1214 microversion: 2.1 time: 0.068538 Aug 27 04:07:30.062218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 311/652] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:29 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:30.246306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:30.247573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:30.262620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:30.262620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:30.262620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:30.262620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:30.281368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:30.281978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:30.298045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:30.299461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:30.300284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:30.300724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:30.454393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.464560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-78329c14-693f-490f-947e-fdcd59daf4a5 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.218101 Aug 27 04:07:30.475806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 342/653] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:30 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:30.482794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:30.495349 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-831ffcf5-8bad-47b2-a383-0c8092aec813 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.217513 Aug 27 04:07:30.496144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 312/654] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:30 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:31.044304 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:31.045571 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:31.052116 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.052950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.053991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.054437 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.079480 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:31.083470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:31.092911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.093491 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.094770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.097234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.220305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:31.228413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2c83e186-ec65-498c-831c-afe4d1b26460 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.153562 Aug 27 04:07:31.236433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 313/655] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:31 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:31.238150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:31.248094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:31.249612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:31.250880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-65aac719-5f4a-4757-ba29-b378524c2974 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.210369 Aug 27 04:07:31.251444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 343/656] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:31 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:31.499657 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:31.507638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:31.514051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:31.514933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:31.516022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.516622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.517397 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.517887 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.527050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.527520 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.528319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:31.534743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:31.698438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:31.705865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-140cdf16-5bc6-497d-8d47-40710e11961d tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.226042 Aug 27 04:07:31.706446 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 314/657] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:31 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:31.728412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:31.736276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a33d76dd-069f-4417-af83-3179282d15d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.226665 Aug 27 04:07:31.736856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 344/658] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:31 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:32.252349 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:32.252944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:32.258862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.259307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.260655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.261093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.277136 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:32.277729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:32.284393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.284845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.285634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.286070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.329438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.337899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4b2fa5a6-3798-4397-adfc-b79c69912b7c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.088995 Aug 27 04:07:32.338717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 315/659] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:32 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:32.431327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.440485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.442177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.443502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e7bdec84-078a-46d0-9898-3d0c88034afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.170431 Aug 27 04:07:32.444299 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 345/660] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:32 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:32.722982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:32.723593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:32.730001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.730446 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.731246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.731686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.753071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:32.753676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:32.760653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.761430 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.762418 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:32.763052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:32.898407 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.906977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-036d0c77-df24-48c4-b419-e58c0dbd8e36 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.187579 Aug 27 04:07:32.907687 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 316/661] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:32 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:32.959971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:32.965048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2b4575a4-4b43-4daa-8ed9-13420a643d6d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.215242 Aug 27 04:07:32.965616 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 346/662] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:32 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:33.355506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:33.356124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:33.362592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.363043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.363820 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.364256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.425405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:33.433471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b799f411-7dc4-4a8a-a4d4-6217877b299b tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.082139 Aug 27 04:07:33.434058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 317/663] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:33 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:33.462739 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:33.464474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:33.471859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.472355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.473193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.473650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.617786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:33.627389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:33.628890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:33.630037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0393ab18-8dbf-4a08-a8b0-9d19244dccc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.171456 Aug 27 04:07:33.630607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 347/664] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:33 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:33.997942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:33.997942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:33.997942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.997942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.999378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.999378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.999565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:33.999565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:33.999565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.999565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:33.999911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:33.999911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:34.398129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.407904 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-76bbb400-e825-4c6e-9004-f8f2fcc32644 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.486502 Aug 27 04:07:34.416139 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 318/665] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:33 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:34.443457 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.455682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0f509674-5a5b-452d-b88a-78036b66688a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.470278 Aug 27 04:07:34.455682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 348/666] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:33 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:34.460209 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:34.460980 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:34.474906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:34.475306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:34.476245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:34.476678 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:34.562581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.568614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a0dbc3e7-b31d-4404-b3b8-3c6f7aa2bfb8 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.119154 Aug 27 04:07:34.569123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 319/667] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:34 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:34.648396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:34.649497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:34.660304 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:34.660763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:34.661614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:34.662088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:34.796910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.805117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.807315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:34.811254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5c3160b8-81f1-4cb0-913b-0b75bfa7354e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.164715 Aug 27 04:07:34.814657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 349/668] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:34 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:35.427513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:35.428113 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:35.434436 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.434928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.435694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.436123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.480397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:35.482034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:35.490860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.491705 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.492561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.493190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.656553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.665461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-89c419f4-968d-432f-9b24-f1633cc7e657 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.241847 Aug 27 04:07:35.676270 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.677161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 320/669] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:35 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:35.683062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:35.683909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:35.690057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.690511 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.691528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.692097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cf55eddd-adde-4ec5-9eee-2df17fc7243b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.218154 Aug 27 04:07:35.692383 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.692991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 350/670] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:35 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:35.763871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.771661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-266ca3ca-fb4e-48ce-bfcd-b9192e1f4a13 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.093197 Aug 27 04:07:35.772233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 321/671] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:35 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:35.826878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:35.827486 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:35.833708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.834159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.835034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:35.835466 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:35.976417 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.986414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.987932 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:35.989064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fefdcf5d-2d49-428b-9b39-36aad72e5903 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.166210 Aug 27 04:07:35.989618 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 351/672] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:35 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:36.683245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:36.683872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:36.689670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:36.690112 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:36.690898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:36.691324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:36.708590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:36.709213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:36.715239 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:36.715691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:36.716468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:36.717108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:36.889577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:36.897956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-44f56208-f89c-4dbb-8ede-dde6f7bd1300 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.218943 Aug 27 04:07:36.898574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 322/673] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:36 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:36.899348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:36.903019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:36.903638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:36.907325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a2dd50b9-05e0-4212-a14d-9e6c270b93e1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.202416 Aug 27 04:07:36.907911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 352/674] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:36 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:36.909599 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:36.910043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:36.910847 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:36.911275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:36.972603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:36.981645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-54348f8a-84b2-4c6a-889f-829b1804fe9c tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.082057 Aug 27 04:07:36.982228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 323/675] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:36 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:37.008550 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:37.009169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:37.015232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:37.015682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:37.016463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:37.016902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:37.144588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:37.152642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:37.154181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:37.155349 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-af70b012-1409-44e2-a9d0-daa12c7b58c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.150511 Aug 27 04:07:37.155905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 353/676] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:37 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:37.915047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:37.915683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:37.922237 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:37.925740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:37.925740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:37.925740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:37.926015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:37.926015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:37.931711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:37.932204 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:37.933103 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:37.933548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:38.129355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.133695 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.138189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-63e358c9-edca-47c5-a3e9-11d54bd48d59 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.226799 Aug 27 04:07:38.138798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 324/677] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:37 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:38.141526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0ea84348-f7ca-4194-b2da-cc594db47781 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.220468 Aug 27 04:07:38.142088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 354/678] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:37 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:38.143143 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:38.143934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:38.149877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:38.150249 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:38.151192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:38.151632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:38.174719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:38.175242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:38.181034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:38.182191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:38.182843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:38.183473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:38.213444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.221389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b8aae96b-2c97-4f5e-99a2-ed0f9e0e477a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.081560 Aug 27 04:07:38.221963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 325/679] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:38 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:38.309311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.317185 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.318851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:38.320108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-879facd6-a806-4e40-ba77-58319b4bc518 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.149457 Aug 27 04:07:38.320728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 355/680] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:38 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:39.156302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:39.156930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:39.158824 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:39.159509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:39.168815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.168815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.168815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.168815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.169226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.169226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.169226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.169226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.351042 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.363146 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-85c40f8e-bf7b-4399-85b8-a1b4eb3e92d0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.209745 Aug 27 04:07:39.372664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 326/681] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:39 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:39.376271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.377370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:39.377986 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:39.384014 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.384477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.386540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.387063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.395663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9d89ab5b-e0e1-4ec8-bdef-3b1fa8886ecb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.240105 Aug 27 04:07:39.396566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 356/682] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:39 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:39.412210 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:39.412831 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:39.432063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.432677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.433933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:39.434640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:39.471205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.481564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a4cc7ae3-0aee-433f-9df9-b2514147fb9e tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1218 microversion: 2.1 time: 0.107620 Aug 27 04:07:39.485265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 327/683] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:39 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:39.808419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.823523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.825382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:39.826693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1ae2aeaa-1671-4c2f-9e18-dcc63f8a05cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.420853 Aug 27 04:07:39.827606 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 357/684] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:39 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:40.389085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:40.389085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:40.403162 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.403630 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.404470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.405193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.413081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:40.413754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:40.420761 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.421223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.422026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.422466 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.825242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:40.833672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-922dd397-77ac-46de-a720-341902d73209 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1515 microversion: 2.1 time: 0.457258 Aug 27 04:07:40.834283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 328/685] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:40 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1515 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:40.849322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:40.850196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:40.853854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:40.877511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5c93c9b3-a706-41b8-b54d-28d4c48bf138 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.467959 Aug 27 04:07:40.878095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 358/686] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:40 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:40.886015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.889236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:40.890064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.892181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.892580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:40.895174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.953363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.954191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:40.961127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:40.961127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:41.148577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:41.161919 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-448cda10-3da5-45ea-9e35-1bbbc537d053 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1274 microversion: 2.1 time: 0.325225 Aug 27 04:07:41.163346 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 329/687] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:40 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1274 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:41.175569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-87a499ab-fdb3-48d1-bcb9-20de09ab826a req-ed16794a-d72b-404f-b20c-b16519fcc153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8372e50f-df43-4829-b2c7-7d1a9334f817", "name": "network-vif-deleted", "tag": "e27b77a5-6aea-4f02-b303-64570873e3a4"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:41.180018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:41.180018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:07:41.191837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-87a499ab-fdb3-48d1-bcb9-20de09ab826a req-ed16794a-d72b-404f-b20c-b16519fcc153 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:41.192947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-87a499ab-fdb3-48d1-bcb9-20de09ab826a req-ed16794a-d72b-404f-b20c-b16519fcc153 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:41.221621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-87a499ab-fdb3-48d1-bcb9-20de09ab826a req-ed16794a-d72b-404f-b20c-b16519fcc153 service nova] Creating event network-vif-deleted:e27b77a5-6aea-4f02-b303-64570873e3a4 for instance 8372e50f-df43-4829-b2c7-7d1a9334f817 on hv-cinder-80475 Aug 27 04:07:41.225917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-87a499ab-fdb3-48d1-bcb9-20de09ab826a req-ed16794a-d72b-404f-b20c-b16519fcc153 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060536 Aug 27 04:07:41.227308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 330/688] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:41.335921 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:41.349218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:41.350481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:41.351899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9b3dda23-bf0a-44a2-a2c1-49a272cf59eb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.471681 Aug 27 04:07:41.353437 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 359/689] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:40 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:41.859078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:41.859078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:41.864055 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:41.864674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:41.865628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:41.866168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:41.906924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:41.908377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:41.909661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:41.910117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:41.910595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'fault' on Instance uuid 8372e50f-df43-4829-b2c7-7d1a9334f817 {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:41.922552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:41.965895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:41.965895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:41.965895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:42.101672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.116623 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-25d25126-c617-4541-a34c-83292c2b17fb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 200 len: 1308 microversion: 2.1 time: 0.262724 Aug 27 04:07:42.116623 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 331/690] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:41 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 1308 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:42.186676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:42.187312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:42.195704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:42.196680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:42.200171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:42.201166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:42.243540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.253327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-28301077-9d47-4104-adc3-c589653a902f tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.353362 Aug 27 04:07:42.254414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 360/691] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:41 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:42.308289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.320106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a9715573-a755-4948-a3f2-a31d5b899c93 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1272 microversion: 2.1 time: 0.138219 Aug 27 04:07:42.331692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 332/692] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:42 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:42.377678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:42.377678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:42.383675 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:42.389585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:42.390846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:42.391462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:42.643890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.662236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.664118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:42.665304 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-889f6614-4334-4055-8fcc-50d9dc3264f9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.294142 Aug 27 04:07:42.665941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 361/693] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:42 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:43.129136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.129747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 8372e50f-df43-4829-b2c7-7d1a9334f817] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:43.135766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.136417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.137291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.137770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.151721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] HTTP exception thrown: Instance 8372e50f-df43-4829-b2c7-7d1a9334f817 could not be found. Aug 27 04:07:43.152311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Returning 404 to user: Instance 8372e50f-df43-4829-b2c7-7d1a9334f817 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:43.153136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d8a5f88b-6104-4e4d-9a63-9fb1f416572a tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817" status: 404 len: 111 microversion: 2.1 time: 0.027779 Aug 27 04:07:43.153671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 333/694] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:43 2021] GET /compute/v2.1/servers/8372e50f-df43-4829-b2c7-7d1a9334f817 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:43.161409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.161928 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:43.168859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.169312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.170120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.170531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.195309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:07:43.244001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-a96640a7-cb1a-4144-9d25-cf2584b07837 req-2cc61828-0d3e-4125-beb6-80467f0a4dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:43.246207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:43.246207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:07:43.253442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-a96640a7-cb1a-4144-9d25-cf2584b07837 req-2cc61828-0d3e-4125-beb6-80467f0a4dac service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.256119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-a96640a7-cb1a-4144-9d25-cf2584b07837 req-2cc61828-0d3e-4125-beb6-80467f0a4dac service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.266230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-a96640a7-cb1a-4144-9d25-cf2584b07837 req-2cc61828-0d3e-4125-beb6-80467f0a4dac service nova] Creating event network-changed:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:07:43.272609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-a96640a7-cb1a-4144-9d25-cf2584b07837 req-2cc61828-0d3e-4125-beb6-80467f0a4dac service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032008 Aug 27 04:07:43.273622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 334/695] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:07:43.280487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.280640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:43.287254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.289973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.289973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.289973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.532834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:43.552865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ab4c222a-5174-49e2-999b-54bee220f959 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.265388 Aug 27 04:07:43.552865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 335/696] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:43 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:43.552865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.552865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:43.553382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.553974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.554958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.555459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.636043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-004b7ec7-fdd5-4e3f-8168-870764de7e9f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 204 len: 0 microversion: 2.1 time: 0.477823 Aug 27 04:07:43.637978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 362/697] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:07:43 2021] DELETE /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:43.656203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.657390 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:43.664683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.665505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.667131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.667838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.819227 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:43.828068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4d4fcacf-9b0d-48dc-aa00-d6059d665f42 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.284740 Aug 27 04:07:43.828670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 336/698] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:43 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:43.833145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:43.834141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:43.840706 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.841151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.841936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:43.842365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:43.987371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:43.997021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e68c4e7f-fa4d-4110-9c70-f9542e2a13ba tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1514 microversion: 2.1 time: 0.344589 Aug 27 04:07:44.007826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 363/699] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:43 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:44.013781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-668ff0c0-0049-4282-bf1e-3254cdd6bbff req-bf590a97-d8f2-4f2a-b154-b47008c25dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde7942a-9e9c-482b-9cf5-fb0b5466e65b", "tag": "266cf5f8-78cd-4a24-a33e-a929c83a616e"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:44.015845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:44.015845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:44.026173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-668ff0c0-0049-4282-bf1e-3254cdd6bbff req-bf590a97-d8f2-4f2a-b154-b47008c25dbc service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:44.026728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-668ff0c0-0049-4282-bf1e-3254cdd6bbff req-bf590a97-d8f2-4f2a-b154-b47008c25dbc service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:44.083503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-668ff0c0-0049-4282-bf1e-3254cdd6bbff req-bf590a97-d8f2-4f2a-b154-b47008c25dbc service nova] Creating event network-changed:266cf5f8-78cd-4a24-a33e-a929c83a616e for instance cde7942a-9e9c-482b-9cf5-fb0b5466e65b on hv-cinder-80475 Aug 27 04:07:44.083503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-668ff0c0-0049-4282-bf1e-3254cdd6bbff req-bf590a97-d8f2-4f2a-b154-b47008c25dbc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073988 Aug 27 04:07:44.083503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 364/700] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:44.134040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:44.147716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:44.149545 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:44.151710 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aac61ecd-f960-4cf8-98e2-a24e20c0b6f8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.321351 Aug 27 04:07:44.152289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 337/701] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:43 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:44.559986 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:44.560843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:44.568180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:44.568447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:44.569439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:44.570337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:44.704447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:44.712026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6db78e6d-d47c-488c-a1e2-c2f21f5a371d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.157191 Aug 27 04:07:44.713160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 365/702] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:44 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:44.848207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:44.848859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:44.855394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:44.855842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:44.856620 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:44.857081 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:44.983388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:44.991623 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-04beadad-b43f-482a-a13a-632bf878d38d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.148458 Aug 27 04:07:44.992207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 338/703] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:44 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:45.015519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:45.016124 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:45.022060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:45.022439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:45.023265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:45.023709 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:45.145748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:45.153592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ce2ac50f-958a-4e4e-8a37-2f034e312b6e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1514 microversion: 2.1 time: 0.141822 Aug 27 04:07:45.154158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 366/704] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:45 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1514 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:45.170166 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:45.170801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:45.177003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:45.177454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:45.178296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:45.178716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:45.308211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:45.316081 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:45.317592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:45.318770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cdd6b24a-dedb-4290-98dc-e9c5f09ca181 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.152969 Aug 27 04:07:45.319324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 339/705] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:45 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:45.732995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:45.734040 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:45.741199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:45.741688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:45.742649 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:45.743099 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:45.895135 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:45.904750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a6003751-7984-491d-8d71-6384b0fd1173 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.179052 Aug 27 04:07:45.905825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 367/706] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:45 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:46.008341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:46.008871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:46.015908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.016363 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.017140 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.017576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.166993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:46.171308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:46.171914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:46.173239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-24054ec6-de1d-46b3-a2ab-bcbc401b5baf tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.168516 Aug 27 04:07:46.174251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 340/707] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:46 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:46.179530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.179984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.180780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.181211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.323108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:46.334494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cb8c5200-793a-472a-b69d-68e5e8e1a2bb tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1514 microversion: 2.1 time: 0.166783 Aug 27 04:07:46.335497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 368/708] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:46 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:46.337306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:46.338619 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:46.347247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.347868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.349141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.350648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.472668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-0b6129fc-3dea-4b42-b3f2-d11abbf9e994 req-abf5e2eb-6d6d-4794-bdb1-a90959ec4366 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bdd098-dd03-464a-9fcb-b6def54ab684", "name": "network-vif-deleted", "tag": "8e649769-14df-4b18-9356-5317f00eaeb7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:46.473215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:46.473215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:46.481776 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-0b6129fc-3dea-4b42-b3f2-d11abbf9e994 req-abf5e2eb-6d6d-4794-bdb1-a90959ec4366 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.482228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-0b6129fc-3dea-4b42-b3f2-d11abbf9e994 req-abf5e2eb-6d6d-4794-bdb1-a90959ec4366 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.494988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-0b6129fc-3dea-4b42-b3f2-d11abbf9e994 req-abf5e2eb-6d6d-4794-bdb1-a90959ec4366 service nova] Creating event network-vif-deleted:8e649769-14df-4b18-9356-5317f00eaeb7 for instance a8bdd098-dd03-464a-9fcb-b6def54ab684 on hv-cinder-80475 Aug 27 04:07:46.500213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-0b6129fc-3dea-4b42-b3f2-d11abbf9e994 req-abf5e2eb-6d6d-4794-bdb1-a90959ec4366 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032037 Aug 27 04:07:46.501269 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 369/709] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:46.524850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:46.533921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:46.536199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:46.537630 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e33e85dc-eeb8-4ffd-91ae-6a30c6d03346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.204338 Aug 27 04:07:46.538225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 341/710] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:46 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:46.930523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:46.932285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:46.939125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.939596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:46.940593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:46.941034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.116923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.119972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-17cd1a26-98fb-47b7-a354-170f7465d6be tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.194040 Aug 27 04:07:47.120509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 370/711] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:46 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:47.191844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:47.192698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:47.200246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.200697 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.201472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.201905 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.326773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.334263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-77064bdd-e126-4380-8c1e-62db9940f99d tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.146536 Aug 27 04:07:47.334862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 342/712] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:47 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:47.351848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:47.352609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:47.359376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.359819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.360588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.361016 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.402947 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.403399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.403859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'fault' on Instance uuid a8bdd098-dd03-464a-9fcb-b6def54ab684 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:47.445306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.453508 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1b3ad1cf-7e48-429e-a883-9dd6c3053dcd tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 200 len: 1308 microversion: 2.1 time: 0.105371 Aug 27 04:07:47.454071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 371/713] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:47 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:47.555923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:47.556643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:47.562633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.563084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.563846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:47.564276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:47.688910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.696780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.698813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:47.699935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a9499624-f5a0-476d-8fa1-e036474d5ca3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.147781 Aug 27 04:07:47.700488 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 343/714] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:47 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:48.136782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.137458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:48.143260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.143710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.144465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.144895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.268268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.276654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f593d5fa-858b-4c99-bf79-f28dd3548042 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.143494 Aug 27 04:07:48.277231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 372/715] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:48 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:48.351963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.352561 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:48.358514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.358990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.359760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.360221 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.469969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.470945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: a8bdd098-dd03-464a-9fcb-b6def54ab684] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:48.476682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.477079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.477868 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.478983 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.485375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.495281 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] HTTP exception thrown: Instance a8bdd098-dd03-464a-9fcb-b6def54ab684 could not be found. Aug 27 04:07:48.495884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Returning 404 to user: Instance a8bdd098-dd03-464a-9fcb-b6def54ab684 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:48.496729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-35d0bcfe-82ec-4b15-9184-687235b85d1b tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684" status: 404 len: 111 microversion: 2.1 time: 0.030743 Aug 27 04:07:48.497293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 373/716] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:48 2021] GET /compute/v2.1/servers/a8bdd098-dd03-464a-9fcb-b6def54ab684 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:07:48.497906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8ba31e77-1cca-4e7b-bbd6-3e15afc605ab tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.148722 Aug 27 04:07:48.499240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 344/717] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:48 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:48.717617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:48.718230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:48.723883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.724452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.725233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:48.725664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:48.937355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.945768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.947523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:48.948823 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1435594b-b396-4591-91d8-6bc2b4b8e9bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.234912 Aug 27 04:07:48.949459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 374/718] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:48 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:49.293667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:49.298088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:49.300473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.301119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.301868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.302296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.435577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:49.442825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-439f7d28-c684-460f-bcb7-f75619af5ec5 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.153579 Aug 27 04:07:49.443388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 345/719] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:49 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:49.515301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:49.515897 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:49.521724 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.522110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.522903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.523330 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.655744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:49.663232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-acaa8326-5336-4676-ae3a-1f29dffe5264 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.151577 Aug 27 04:07:49.663787 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 375/720] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:49 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:49.934911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:49.935503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:49.941970 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.963097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.963097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.963097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.969284 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:49.969977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:49.971225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:07:49.976717 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.977458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:49.979217 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:49.979696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.103236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.110921 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.112401 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.113513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a4d588b2-62d6-4dfc-8afe-b57c4c2f0c8a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.150505 Aug 27 04:07:50.114064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 376/721] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:49 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:50.415444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d8c6a872-da31-4ea7-805d-7d664ef4ab73 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "DELETE /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 204 len: 0 microversion: 2.1 time: 0.483571 Aug 27 04:07:50.416259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 346/722] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:07:49 2021] DELETE /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:50.427175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:50.427818 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:50.434451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:50.434939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.435718 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:50.436158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.476101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:50.476101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:50.476101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:50.476101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.476916 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:50.476916 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.600849 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.609143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8d78e501-88e9-495c-9d21-6bc2550e7893 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1515 microversion: 2.1 time: 0.185853 Aug 27 04:07:50.609723 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 377/723] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:50 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1515 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:50.644454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.644454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0b79f051-f7b9-48cd-af04-e8281e560acc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.187061 Aug 27 04:07:50.644454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 347/724] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:50 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:50.680656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:50.681365 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:50.687854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:50.688303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.689063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:50.689504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:50.816102 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:50.823273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7552f8ed-4dc0-4902-86da-7c4b139775fa tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.146410 Aug 27 04:07:50.823842 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 378/725] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:50 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:51.124138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-60e50d13-3a20-401b-996b-557b9d16fb95 req-d1bbda43-f593-43f8-a483-1fa15df77d92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde7942a-9e9c-482b-9cf5-fb0b5466e65b", "name": "network-vif-plugged", "status": "completed", "tag": "266cf5f8-78cd-4a24-a33e-a929c83a616e"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:51.127055 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:51.127055 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:07:51.131951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:51.132562 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:51.138865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-60e50d13-3a20-401b-996b-557b9d16fb95 req-d1bbda43-f593-43f8-a483-1fa15df77d92 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.139053 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.139322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-60e50d13-3a20-401b-996b-557b9d16fb95 req-d1bbda43-f593-43f8-a483-1fa15df77d92 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.139457 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.140198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.140638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.154107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-60e50d13-3a20-401b-996b-557b9d16fb95 req-d1bbda43-f593-43f8-a483-1fa15df77d92 service nova] Creating event network-vif-plugged:266cf5f8-78cd-4a24-a33e-a929c83a616e for instance cde7942a-9e9c-482b-9cf5-fb0b5466e65b on hv-cinder-80475 Aug 27 04:07:51.160173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-60e50d13-3a20-401b-996b-557b9d16fb95 req-d1bbda43-f593-43f8-a483-1fa15df77d92 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039629 Aug 27 04:07:51.160775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 348/726] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:07:51.274605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.283628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.285424 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.286722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2ea7b111-2995-47ec-bec8-619a5bcb2c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.158417 Aug 27 04:07:51.287291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 379/727] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:51 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:51.627033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:51.627791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:51.637208 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.638192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.638526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.638990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.664092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:51.665083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:51.683000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.684068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.685340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.686712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.824186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.832464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bc245a55-42f5-4989-8a16-7fb2aa44386e tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1515 microversion: 2.1 time: 0.209780 Aug 27 04:07:51.833129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 349/728] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:51 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:51.839035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:51.840907 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:51.847368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.847816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.848661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:51.849097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:51.860708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.867955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b7ef3ee2-256c-428d-bd16-95bd5de3fa36 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.211086 Aug 27 04:07:51.868505 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 380/729] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:51 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:51.983910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:51.991523 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9809e5a4-d2f1-45fc-98e0-e50c9a50a340 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.156612 Aug 27 04:07:51.995265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 350/730] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:51 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:52.306499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:52.307305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:52.313366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:52.313922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:52.314741 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:52.315183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:52.438868 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:52.447067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:52.448601 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:52.449755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7736c6d6-6aae-4cc6-986c-752664cf0753 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.147752 Aug 27 04:07:52.450323 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 381/731] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:52 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:52.848866 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:52.849484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:52.855699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:52.858375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:52.858375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:52.858375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:52.885560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:52.890203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:52.902898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:52.903353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:52.904150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:52.904640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.013821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:53.021584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9c282bc9-fe87-420e-ad88-45f84c4b9392 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1515 microversion: 2.1 time: 0.176275 Aug 27 04:07:53.031773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 351/732] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:52 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:53.035196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:53.035820 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:53.042042 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:53.042497 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.043334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:53.043770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.068882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:53.077519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3c2f2762-1c9e-48c5-ae4d-644f75ada4d0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.196100 Aug 27 04:07:53.078100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 382/733] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:52 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:53.174362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:53.176625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-7e91c31f-5858-4fcb-a28e-d49e5937a493 req-6afa9a7c-4058-440b-bbb9-edbab8c4cb01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "name": "network-vif-plugged", "status": "completed", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:53.178413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:53.178413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:53.183578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9d739551-cb9e-4308-a5d2-9382e9840dbb tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1314 microversion: 2.1 time: 0.159325 Aug 27 04:07:53.185784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 352/734] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:53 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:53.186662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-7e91c31f-5858-4fcb-a28e-d49e5937a493 req-6afa9a7c-4058-440b-bbb9-edbab8c4cb01 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:53.187185 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-7e91c31f-5858-4fcb-a28e-d49e5937a493 req-6afa9a7c-4058-440b-bbb9-edbab8c4cb01 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.198775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-7e91c31f-5858-4fcb-a28e-d49e5937a493 req-6afa9a7c-4058-440b-bbb9-edbab8c4cb01 service nova] Creating event network-vif-plugged:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:07:53.203703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-7e91c31f-5858-4fcb-a28e-d49e5937a493 req-6afa9a7c-4058-440b-bbb9-edbab8c4cb01 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031516 Aug 27 04:07:53.204295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 383/735] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:07:53.468111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:53.468787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:53.480908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:53.482110 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.483271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:53.484512 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.687596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:53.697742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:53.700679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:53.701955 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b4d90b88-5d4e-4d9e-a71a-9b4bc9fe9756 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.238335 Aug 27 04:07:53.702590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 353/736] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:53 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:53.867552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-c21ccb14-d3f3-47dd-8d8e-a86e313bc7d7 req-bf28a667-f4fc-4830-b9ff-be773072820b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "664ae18c-f051-4b0e-a20b-d77df52d1a1a", "name": "network-vif-deleted", "tag": "8e4eacb7-9daf-4803-972f-81d8c117a2c4"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:53.869062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:53.869062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:53.876851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-c21ccb14-d3f3-47dd-8d8e-a86e313bc7d7 req-bf28a667-f4fc-4830-b9ff-be773072820b service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:53.877206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-c21ccb14-d3f3-47dd-8d8e-a86e313bc7d7 req-bf28a667-f4fc-4830-b9ff-be773072820b service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:53.888687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-c21ccb14-d3f3-47dd-8d8e-a86e313bc7d7 req-bf28a667-f4fc-4830-b9ff-be773072820b service nova] Creating event network-vif-deleted:8e4eacb7-9daf-4803-972f-81d8c117a2c4 for instance 664ae18c-f051-4b0e-a20b-d77df52d1a1a on hv-cinder-80475 Aug 27 04:07:53.894735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-c21ccb14-d3f3-47dd-8d8e-a86e313bc7d7 req-bf28a667-f4fc-4830-b9ff-be773072820b service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031023 Aug 27 04:07:53.895834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 384/737] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:54.039301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.039910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:54.046445 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.046929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.047694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.048126 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.095285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.096031 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:54.102213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.102730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.103544 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.104604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.112771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:54.121670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b63cc4a8-0c53-45a9-9854-4c2df79d0ca0 tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1473 microversion: 2.1 time: 0.085912 Aug 27 04:07:54.122269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 354/738] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:54 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1473 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:54.200314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.201028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:54.207583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.208030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.209000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.209442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.240143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:54.252328 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-00ed50bf-86ae-4d93-bebe-7dd1410ee79c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.160866 Aug 27 04:07:54.253029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 385/739] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:54 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:54.346491 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:54.355317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7f05a6f0-2a78-4d0e-ae31-76f7c985ea19 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1464 microversion: 2.1 time: 0.159159 Aug 27 04:07:54.355850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 355/740] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:54 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:54.393691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.394187 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:54.400295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.401396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.402343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.402843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.429625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:07:54.720792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.726662 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:54.727795 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.728248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.729730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.730196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.884562 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-771d2a91-6c48-4473-8850-0a0240d3d146 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 204 len: 0 microversion: 2.1 time: 0.494437 Aug 27 04:07:54.885978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 386/741] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:07:54 2021] DELETE /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:07:54.894843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:54.895552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:54.902440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.902938 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:54.903826 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:54.904259 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:55.192354 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.204338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.207156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.208824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2b2ae404-0a47-453d-9c26-d43fe90f8830 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.491741 Aug 27 04:07:55.210517 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 356/742] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:54 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:07:55.218989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:55.220654 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:55.231729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:55.232813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:55.234214 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:55.235226 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:55.267800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.286407 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:55.286912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:55.287374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lazy-loading 'fault' on Instance uuid 664ae18c-f051-4b0e-a20b-d77df52d1a1a {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:55.287586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c576042b-f14a-48f7-bea9-b2008fd586fc tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1470 microversion: 2.1 time: 0.396973 Aug 27 04:07:55.288180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 387/743] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:54 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:55.299442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:55.300396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:55.309635 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:55.310085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:55.311456 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:55.311907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:55.335749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21ac4ce459d4eee9f73d4c7207968b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c67ffd3553c245acabcdcfd5a15252e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.344510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9768c0a8-46c9-4b2b-9698-7a810f71051c tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 200 len: 1308 microversion: 2.1 time: 0.132305 Aug 27 04:07:55.345086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 357/744] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:55 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:55.476447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:55.485578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1897d176-a8ee-4ff4-9b85-a7a1a1ca2bf7 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1359 microversion: 2.1 time: 0.193832 Aug 27 04:07:55.494995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 388/745] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:55 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:56.228489 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.229164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:56.235636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.236089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.236871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.237305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.306678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.309451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:56.316437 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.316895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.317880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.318314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.394218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.402790 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.404358 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.405714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f5e16acb-3559-4119-9f81-13184694d67c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.181381 Aug 27 04:07:56.406275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 358/746] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:56 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:56.411485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.412459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] [instance: 664ae18c-f051-4b0e-a20b-d77df52d1a1a] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:56.421220 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.421675 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.422705 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.423069 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.439562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] HTTP exception thrown: Instance 664ae18c-f051-4b0e-a20b-d77df52d1a1a could not be found. Aug 27 04:07:56.440186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] Returning 404 to user: Instance 664ae18c-f051-4b0e-a20b-d77df52d1a1a could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:56.441128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-23959636-0373-494b-abfd-3dbe2e7b7f0f tempest-AttachVolumeNegativeTest-2033834462 tempest-AttachVolumeNegativeTest-2033834462-project] 10.222.0.73 "GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a" status: 404 len: 111 microversion: 2.1 time: 0.033920 Aug 27 04:07:56.441857 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 359/747] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:56 2021] GET /compute/v2.1/servers/664ae18c-f051-4b0e-a20b-d77df52d1a1a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:07:56.471735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.482595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6510f38e-e3e2-4e1b-9933-44123ba96259 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1470 microversion: 2.1 time: 0.180322 Aug 27 04:07:56.483671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 389/748] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:56 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:56.502289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.503378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:56.511782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.512662 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.513602 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.514507 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.659350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.668305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9c2f8a2b-7904-446a-92f1-241a79fac643 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1549 microversion: 2.1 time: 0.169718 Aug 27 04:07:56.668872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 360/749] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:56 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1549 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:56.685518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.686174 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:56.692780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.693261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.694051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.694640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.830590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.839650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-05d43d6c-cfb2-4663-8bc9-f579f9e71e43 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1549 microversion: 2.1 time: 0.158367 Aug 27 04:07:56.840888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 390/750] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:56 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:56.856961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:56.860287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:56.860287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:07:56.861277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:56.863533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Searching by: {'deleted': False, 'project_id': '28d44e8045c24df28323402022ac9228'} {{(pid=108985) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 27 04:07:56.871561 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.872009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.883303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:56.883303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:56.989907 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.multi_cell_list [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108985) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 27 04:07:57.103443 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c838da8e-e79d-44fa-b86e-34669987bd2c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.250555 Aug 27 04:07:57.105791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 361/751] 10.222.0.73 () {58 vars in 1125 bytes} [Fri Aug 27 04:07:56 2021] GET /compute/v2.1/servers => generated 343 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:57.116301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:57.117295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:57.123343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.123801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.124584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.125329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.267699 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:57.275047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3807f0a5-e65a-4f0c-95d8-3528c8eb64f6 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1549 microversion: 2.1 time: 0.162684 Aug 27 04:07:57.276570 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 391/752] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:57 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:57.425137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:57.425892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:57.434116 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.434968 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.436041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.436757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.501125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:57.501859 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:57.508331 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.508787 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.509759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.510482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.594199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:57.605598 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:57.607667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:57.609117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4268a229-b662-4cf2-8223-c832408d9837 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1743 microversion: 2.20 time: 0.188471 Aug 27 04:07:57.609862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 362/753] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:57 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1743 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:57.675129 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:57.697185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-3530d40c-aea9-4e99-810f-de7a1b2be583 req-79c2ca40-44c7-4092-9aaa-aae7d3dff468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde7942a-9e9c-482b-9cf5-fb0b5466e65b", "name": "network-vif-deleted", "tag": "266cf5f8-78cd-4a24-a33e-a929c83a616e"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:57.698821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:57.698821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:07:57.700841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-584e8ad9-f53a-43e5-9a50-0df2831ed24a tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1470 microversion: 2.1 time: 0.203632 Aug 27 04:07:57.701982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 392/754] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:57 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:07:57.716725 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-3530d40c-aea9-4e99-810f-de7a1b2be583 req-79c2ca40-44c7-4092-9aaa-aae7d3dff468 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:57.717174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-3530d40c-aea9-4e99-810f-de7a1b2be583 req-79c2ca40-44c7-4092-9aaa-aae7d3dff468 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:57.728302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-3530d40c-aea9-4e99-810f-de7a1b2be583 req-79c2ca40-44c7-4092-9aaa-aae7d3dff468 service nova] Creating event network-vif-deleted:266cf5f8-78cd-4a24-a33e-a929c83a616e for instance cde7942a-9e9c-482b-9cf5-fb0b5466e65b on hv-cinder-80475 Aug 27 04:07:57.735003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-3530d40c-aea9-4e99-810f-de7a1b2be583 req-79c2ca40-44c7-4092-9aaa-aae7d3dff468 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041506 Aug 27 04:07:57.736185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 363/755] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:58.628556 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:58.629261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:58.641144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.641500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.642462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.642935 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.726510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:58.727255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:58.748413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.748749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.750679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.750934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.792270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:58.792872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:58.793557 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lazy-loading 'fault' on Instance uuid cde7942a-9e9c-482b-9cf5-fb0b5466e65b {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:07:58.815996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:58.825967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:58.827563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:58.828727 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b5180d48-ccc9-494d-a77c-48b6567bdd3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1743 microversion: 2.20 time: 0.203893 Aug 27 04:07:58.829292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 393/756] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:58 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1743 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:07:58.845667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7037ec4eba3d404487514e3bee56a21e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '769d70d40946487c899a78bcec6dca8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:07:58.854297 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7288cb75-dc4b-461f-9297-399b5d671bbe tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 200 len: 1304 microversion: 2.1 time: 0.138928 Aug 27 04:07:58.860228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 364/757] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:58 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:07:59.072043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-eeaad281-7068-4b9b-8257-da0406970898 req-07926bd1-05a2-478a-9c33-0d0bce6fd3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "name": "network-vif-plugged", "status": "completed", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:07:59.074494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:07:59.074494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:07:59.082055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-eeaad281-7068-4b9b-8257-da0406970898 req-07926bd1-05a2-478a-9c33-0d0bce6fd3dc service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.082502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-eeaad281-7068-4b9b-8257-da0406970898 req-07926bd1-05a2-478a-9c33-0d0bce6fd3dc service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.095327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-eeaad281-7068-4b9b-8257-da0406970898 req-07926bd1-05a2-478a-9c33-0d0bce6fd3dc service nova] Creating event network-vif-plugged:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:07:59.100533 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-eeaad281-7068-4b9b-8257-da0406970898 req-07926bd1-05a2-478a-9c33-0d0bce6fd3dc service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031964 Aug 27 04:07:59.101211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 394/758] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:07:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:07:59.849871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:59.851031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:59.858420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.858969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.859776 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.860210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.872766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:07:59.874296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] [instance: cde7942a-9e9c-482b-9cf5-fb0b5466e65b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:07:59.882923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.883762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.885524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:07:59.886196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:07:59.902347 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] HTTP exception thrown: Instance cde7942a-9e9c-482b-9cf5-fb0b5466e65b could not be found. Aug 27 04:07:59.904471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] Returning 404 to user: Instance cde7942a-9e9c-482b-9cf5-fb0b5466e65b could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:07:59.904830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e8b2f0c8-cd0f-443a-8d5e-ec9430ca3df9 tempest-VolumesNegativeTest-778041054 tempest-VolumesNegativeTest-778041054-project] 10.222.0.73 "GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b" status: 404 len: 111 microversion: 2.1 time: 0.037119 Aug 27 04:07:59.905602 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 395/759] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:07:59 2021] GET /compute/v2.1/servers/cde7942a-9e9c-482b-9cf5-fb0b5466e65b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:08:00.003693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:00.013320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:00.014859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:00.016015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-efe9e060-a242-4d23-bfe1-80d7e017e5ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1743 microversion: 2.20 time: 0.171579 Aug 27 04:08:00.016565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 365/760] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:07:59 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:00.713543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b3f91ba-6ec8-42be-b208-3fb4d43706cc"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:00.714675 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:00.722215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:00.722880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:00.723834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:00.728378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:01.034494 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:01.035191 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:01.041868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:01.042335 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:01.043161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:01.043607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:01.174590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:01.182326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:01.183865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:01.184998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6b4e76f0-ccab-42b1-bee4-611a9d548e48 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1743 microversion: 2.20 time: 0.154356 Aug 27 04:08:01.185543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 366/761] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:01 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1743 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:01.840800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-42cf326c-0e13-4607-a76d-b1f1cccbc183 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.130958 Aug 27 04:08:01.841736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 396/762] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:08:00 2021] POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments => generated 194 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:02.203430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:02.204145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:02.210538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:02.211094 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:02.211985 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:02.212422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:02.351138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:02.359837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:02.361406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:02.362547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2aa1fefd-23af-463b-bd19-be2f84ef545e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1743 microversion: 2.20 time: 0.162954 Aug 27 04:08:02.363119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 367/763] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:02 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:03.381736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:03.382466 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:03.390860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:03.395506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:03.395506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:03.395506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:03.534134 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:03.544971 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:03.550663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:03.550663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b943a485-96e7-40df-af6d-1a8faa6fec5a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.170754 Aug 27 04:08:03.550663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 397/764] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:03 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:04.568719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:04.570176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:04.577093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:04.577686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:04.578504 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:04.579136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:04.719800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:04.745684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:04.745684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:04.745684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3f997395-4f52-43f5-baf9-247626801fc3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.180086 Aug 27 04:08:04.746077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 368/765] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:04 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:05.765041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:05.765642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:05.776549 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:05.777023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:05.777784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:05.778214 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:05.998003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:06.006890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:06.008813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:06.010953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-70f09ec1-be89-4953-b16c-b8484b23d908 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.249824 Aug 27 04:08:06.022441 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 398/766] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:05 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:07.030625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:07.030625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:07.036132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:07.036585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:07.037374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:07.037808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:07.250256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:07.259962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:07.261899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:07.263402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1cb5a3a6-c545-470b-9402-1745b9e95468 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.238294 Aug 27 04:08:07.264396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 369/767] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:07 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:08.293302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:08.293302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:08.324683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:08.324683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:08.324683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:08.324683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:08.488213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:08.498256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:08.500554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:08.502029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2dad6c51-644d-4d5d-a41c-ceeb4c321b6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.218892 Aug 27 04:08:08.503112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 399/768] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:08 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:09.528947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:09.530165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:09.536859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:09.537313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:09.538099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:09.538538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:09.670470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:09.679433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:09.681241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:09.683125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6f769018-3d18-4c72-b44e-ea4bb35abddd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.159426 Aug 27 04:08:09.694678 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 370/769] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:09 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:10.701685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:10.702305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:10.708818 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:10.709276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:10.710132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:10.710600 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:10.860545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:10.872447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:10.874202 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:10.875545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-acfd3e33-d8a1-47ca-b530-67b534be83cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.178216 Aug 27 04:08:10.876200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 400/770] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:10 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:11.895883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:11.906729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:11.906729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:11.906729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:11.907373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:11.908139 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:12.068555 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:12.079656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:12.081453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:12.082840 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8b25b991-b766-4bd4-bed2-b20193f21721 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.193199 Aug 27 04:08:12.083398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 371/771] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:11 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:13.105702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:13.106543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:13.113508 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:13.113982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:13.115231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:13.115616 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:13.253981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:13.270846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:13.272391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:13.273578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0f9519fd-2d31-40bd-9ed5-7092e0639ae1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.172512 Aug 27 04:08:13.274420 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 401/772] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:13 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:14.293558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:14.294837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:14.318179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:14.318775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:14.319629 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:14.320123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:14.491632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:14.515242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:14.518688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:14.521312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-13360435-80e9-4bb4-b32d-8b69465cc316 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.231818 Aug 27 04:08:14.541352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 372/773] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:14 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:15.540151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:15.541148 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:15.547246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:15.547725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:15.548507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:15.548946 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:15.693969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:15.711288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:15.711288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:15.711288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-763a38a8-175f-48ff-b692-32edf1e2469f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.173635 Aug 27 04:08:15.711789 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 402/774] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:15 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:16.624941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:16.625547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:16.631388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:16.631777 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:16.632547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:16.632976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:16.735099 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:16.735708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:16.750226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:16.750725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:16.751521 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:16.751959 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:16.789625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:16.798535 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6ecc3ad2-3aa1-4f19-af88-8dd2d6350303 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1595 microversion: 2.1 time: 0.177136 Aug 27 04:08:16.799936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 373/775] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:16 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1595 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:16.998642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:17.007037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:17.008839 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:17.010125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-196f4828-8a48-434d-b2fb-3c73442e0247 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1738 microversion: 2.20 time: 0.278594 Aug 27 04:08:17.014603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 403/776] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:16 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:18.027973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:18.028588 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:18.034271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:18.034749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:18.035524 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:18.035952 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:18.317891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:18.326584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:18.328104 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:18.330020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-75cdfa40-aca7-46bd-b8c5-c40924e94dbf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1720 microversion: 2.20 time: 0.306333 Aug 27 04:08:18.330602 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 374/777] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:18 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1720 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:19.123238 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-10800987-da7d-4cfa-a622-e6cd4de5eea3 req-fef0f42d-93d6-496f-aea3-f7a8f46e0269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "name": "network-vif-unplugged", "status": "completed", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:19.124883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:08:19.124883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:08:19.132805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-10800987-da7d-4cfa-a622-e6cd4de5eea3 req-fef0f42d-93d6-496f-aea3-f7a8f46e0269 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:19.133257 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-10800987-da7d-4cfa-a622-e6cd4de5eea3 req-fef0f42d-93d6-496f-aea3-f7a8f46e0269 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:19.145174 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-10800987-da7d-4cfa-a622-e6cd4de5eea3 req-fef0f42d-93d6-496f-aea3-f7a8f46e0269 service nova] Creating event network-vif-unplugged:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:08:19.151167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-10800987-da7d-4cfa-a622-e6cd4de5eea3 req-fef0f42d-93d6-496f-aea3-f7a8f46e0269 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032223 Aug 27 04:08:19.151890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 404/778] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:08:19 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:19.349764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:19.350371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:19.357239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:19.357720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:19.358477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:19.358948 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:19.486943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:19.496111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:19.497849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:19.498689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e7ff9fb4-24d4-4c93-b859-23d52da9264a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1720 microversion: 2.20 time: 0.152807 Aug 27 04:08:19.499420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 375/779] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:19 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:19.794815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-2545832a-964b-4e98-9b25-4be6d47c9fe0 req-d6187acd-1621-4a4f-81d2-50d4270e9851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:19.796341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:08:19.796341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:08:19.803918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-2545832a-964b-4e98-9b25-4be6d47c9fe0 req-d6187acd-1621-4a4f-81d2-50d4270e9851 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:19.804360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-2545832a-964b-4e98-9b25-4be6d47c9fe0 req-d6187acd-1621-4a4f-81d2-50d4270e9851 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:19.815982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-2545832a-964b-4e98-9b25-4be6d47c9fe0 req-d6187acd-1621-4a4f-81d2-50d4270e9851 service nova] Creating event network-changed:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:08:19.820819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-2545832a-964b-4e98-9b25-4be6d47c9fe0 req-d6187acd-1621-4a4f-81d2-50d4270e9851 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030878 Aug 27 04:08:19.821693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 405/780] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:08:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:20.517368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:20.522836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:20.530398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:20.530883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:20.531896 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:20.532324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:20.714228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:20.722042 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:20.723572 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:20.724744 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5d4b8de7-ba04-4a73-a620-ef4f5b7d30c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1723 microversion: 2.20 time: 0.211263 Aug 27 04:08:20.725293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 376/781] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:20 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:20.745891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6922cbc8-6710-43f4-ba92-9d76eba8376c"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:20.747219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:20.753768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:20.754358 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:20.755604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:20.756497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:21.956623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6dfe20a7-8736-4a64-abe0-0a47a6f28f56 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.216124 Aug 27 04:08:21.957359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 406/782] 10.222.0.73 () {62 vars in 1364 bytes} [Fri Aug 27 04:08:20 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments => generated 188 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:08:22.116357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:22.119684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:22.123749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:22.124208 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:22.125007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:22.125448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:22.393892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1d33f5b3-0191-476d-b362-f23e22b64c11 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action" status: 202 len: 0 microversion: 2.20 time: 0.281165 Aug 27 04:08:22.394931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 377/783] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:08:22 2021] POST /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:08:22.405449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:22.406264 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:22.413109 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:22.413706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:22.414631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:22.415184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:22.547845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:22.558040 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:22.558995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:22.560166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6dea5aae-3810-4302-9fb3-af0d945d5815 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1749 microversion: 2.20 time: 0.160381 Aug 27 04:08:22.560728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 407/784] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:22 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1749 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:23.315566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-473291427"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:23.316912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:23.323954 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:23.324412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:23.325212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:23.325651 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:23.455922 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.network.security_group_api [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Adding security group 41ddedba-03b1-4a7d-863e-2bf9c24f31f2 to port 14a51c81-8273-4b66-bcee-30da752b0e22 Aug 27 04:08:23.578803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:23.579847 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:23.586139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:23.586933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:23.587917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:23.588351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:23.808537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:23.820137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:23.821640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:23.823454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e6263028-3343-4c3c-9c4c-7d67035c3687 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1749 microversion: 2.20 time: 0.248087 Aug 27 04:08:23.834154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 408/785] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:23 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:24.046095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b61e818d-e83c-4215-92ed-3e28150911c2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/action" status: 202 len: 0 microversion: 2.1 time: 0.734130 Aug 27 04:08:24.047260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 378/786] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:08:23 2021] POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:08:24.054753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-a4672cca-c3ac-4907-9297-463324334dd0 req-4ce2e141-ea8f-4067-a9b6-78b82eba7ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:24.060404 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:24.060944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:24.068158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:08:24.068158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:08:24.081175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-a4672cca-c3ac-4907-9297-463324334dd0 req-4ce2e141-ea8f-4067-a9b6-78b82eba7ae3 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:24.081624 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-a4672cca-c3ac-4907-9297-463324334dd0 req-4ce2e141-ea8f-4067-a9b6-78b82eba7ae3 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:24.089660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:24.095643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:24.096743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:24.097181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:24.126020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-a4672cca-c3ac-4907-9297-463324334dd0 req-4ce2e141-ea8f-4067-a9b6-78b82eba7ae3 service nova] Creating event network-changed:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:08:24.136556 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-a4672cca-c3ac-4907-9297-463324334dd0 req-4ce2e141-ea8f-4067-a9b6-78b82eba7ae3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085249 Aug 27 04:08:24.141070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 409/787] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:08:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:08:24.328823 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:24.337378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4d0848d6-4c20-4691-af75-11284aa98087 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1759 microversion: 2.1 time: 0.281141 Aug 27 04:08:24.340478 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 379/788] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:24 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1759 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:24.853820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:24.855197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:24.863757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:24.867714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:24.867714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:24.867714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:25.004943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:25.014209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:25.015846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:25.017208 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2853d36a-9c6f-48e1-8586-7890c4a4eb8b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1751 microversion: 2.20 time: 0.168065 Aug 27 04:08:25.017869 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 410/789] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:24 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:26.047759 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:26.052062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:26.055269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:26.056517 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:26.057651 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:26.058280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:26.212752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:26.222155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:26.223825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:26.225356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3c093005-c353-4481-a8c1-bcfa2017aa61 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1751 microversion: 2.20 time: 0.181422 Aug 27 04:08:26.225915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 380/790] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:26 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:27.244061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:27.244870 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:27.250890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:27.251452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:27.252276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:27.252716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:27.381378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:27.390654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:27.392364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:27.393497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-631a749d-8765-4d26-8a67-2160c37762aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.153536 Aug 27 04:08:27.394049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 411/791] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:27 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:28.418509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:28.419178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:28.426526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:28.427286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:28.428274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:28.428910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:28.608144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:28.616852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:28.618369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:28.619716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-180016b0-6f2f-499e-bcc1-5f617f68a255 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.209175 Aug 27 04:08:28.620273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 381/792] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:28 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:29.637861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:29.638455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:29.644710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:29.645006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:29.645795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:29.646232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:29.772043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:29.782483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:29.784002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:29.785144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-43c3a6c0-03a2-4a72-a602-986dec8ba213 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.151572 Aug 27 04:08:29.785692 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 412/793] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:29 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:30.651775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-544108413", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "3b08d8a7-8602-418e-b250-eac0cd152297"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:30.712405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] validate_networks() for [('3b08d8a7-8602-418e-b250-eac0cd152297', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:08:30.803637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:30.804391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:30.811673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:30.812226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:30.813368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:30.814096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:31.027774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:31.039822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:31.041670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:31.043043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-689f5e2d-9ec8-4267-9bce-4a3ef54fe714 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.243499 Aug 27 04:08:31.043634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 413/794] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:30 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:31.165921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:08:31.167094 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:08:31.167856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:08:31.168379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:08:31.168803 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:08:31.177797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:31.178259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:31.179139 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:31.179586 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:31.196914 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Getting quotas for project a65ba74164e2464cab37a8459816ebab. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:08:31.201302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Getting quotas for user bc5d70235d054703a69d76fd54daf683 and project a65ba74164e2464cab37a8459816ebab. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:08:31.212273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:08:31.214815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:08:31.375777 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a1aa28d7-cdb1-45f2-8aeb-50825628a0a1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.728133 Aug 27 04:08:31.378252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 382/795] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:08:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:08:31.386246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-35bee709-9d95-4362-b430-ccae0607ed63 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:31.386843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-35bee709-9d95-4362-b430-ccae0607ed63 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:31.448208 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-35bee709-9d95-4362-b430-ccae0607ed63 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:31.456129 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-35bee709-9d95-4362-b430-ccae0607ed63 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1213 microversion: 2.1 time: 0.073444 Aug 27 04:08:31.456803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 414/796] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:31 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:32.061989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:32.062809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:32.068736 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:32.069179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:32.069950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:32.070400 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:32.348972 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:32.348972 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:32.349281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:32.349281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3d5831d6-f1e2-4d11-977f-09f6c6ae4811 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.172458 Aug 27 04:08:32.349281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 383/797] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:32 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:32.473018 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c4526861-d51f-4253-8d84-794c13188297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:32.473655 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c4526861-d51f-4253-8d84-794c13188297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:32.526861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c4526861-d51f-4253-8d84-794c13188297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:32.536100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c4526861-d51f-4253-8d84-794c13188297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1213 microversion: 2.1 time: 0.066611 Aug 27 04:08:32.536855 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 415/798] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:32 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1213 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:33.320078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:33.320800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:33.326899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:33.327345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:33.328101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:33.328518 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:33.461970 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:33.471941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:33.473471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:33.474639 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-afcc16d5-e779-4b53-8fb2-c59469941429 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.159354 Aug 27 04:08:33.475215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 384/799] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:33 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:33.553659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:33.554273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:33.561315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:33.561719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:33.562510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:33.562982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:33.625306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:33.633474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-86ce5638-7509-42ff-92c6-66c6c09e7eb0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.083721 Aug 27 04:08:33.634054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 416/800] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:33 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:34.493307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:34.494267 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:34.500037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:34.500479 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:34.501249 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:34.501676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:34.630495 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:34.640533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:34.642211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:34.643536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7420122a-256b-4ab0-a789-07a4664108c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.154068 Aug 27 04:08:34.644169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 385/801] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:34 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:34.659064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:34.659665 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:34.665475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:34.665915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:34.666721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:34.667779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:34.730097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:34.737737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-744335a9-0830-44e7-bea0-70a06d6b534e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.082302 Aug 27 04:08:34.738377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 417/802] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:34 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:35.663836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:35.664464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:35.671672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:35.672115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:35.672885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:35.673319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:35.756116 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:35.756702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:35.763774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:35.764231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:35.765029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:35.765467 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:35.804792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:35.816606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:35.818647 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:35.820202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-68f8fe54-3b23-4c34-9517-314342bd2117 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.160201 Aug 27 04:08:35.820897 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 386/803] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:35 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:35.834790 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:35.842650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7f4c78ce-ec99-4a24-9355-c7c514f1960e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.090200 Aug 27 04:08:35.843209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 418/804] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:35 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:36.840012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:36.840587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:36.846368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:36.846848 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:36.847629 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:36.848060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:36.858856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:36.860232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:36.866794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:36.867338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:36.868200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:36.868706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:36.947445 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:36.955676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dd053a68-9245-4420-8990-15a4b31b34a9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.100456 Aug 27 04:08:36.956249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 419/805] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:36 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:08:37.008895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:37.018107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:37.019655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:37.020807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-17ee7fac-4ea0-45ac-b3fb-7b4a1d7d76ad tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.185999 Aug 27 04:08:37.021627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 387/806] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:36 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:37.975130 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:37.975130 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:37.980916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:37.981375 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:37.982256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:37.982742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:38.041137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:38.042781 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:38.050645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:38.051108 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:38.052080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:38.052513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:38.065133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.074183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cab65569-ba54-40ff-93a5-1964caeb2bf4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.104541 Aug 27 04:08:38.078292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 420/807] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:37 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:38.213476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.223527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.225072 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:38.226265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1872cc56-2b76-4f32-a319-8c56a5f6adaf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.190350 Aug 27 04:08:38.226806 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 388/808] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:38 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:39.090807 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:39.091435 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:39.097317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:39.097760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:39.098534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:39.098993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:39.159720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:39.168412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-20a98f16-f052-476c-98ab-8e7c326e6458 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.080279 Aug 27 04:08:39.168412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 421/809] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:39 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:39.244941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:39.245810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:39.252003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:39.252449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:39.253252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:39.253702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:39.375836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:39.383891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:39.385375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:39.386604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-494e938f-3a7e-490b-acce-6f4f06d649e1 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.145337 Aug 27 04:08:39.387105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 389/810] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:39 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:40.185682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:40.186489 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:40.194763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:40.195220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:40.196075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:40.196520 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:40.257444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.265751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-37337949-35fb-4545-97de-045050e71ae0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.085375 Aug 27 04:08:40.266431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 422/811] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:40 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:40.404652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:40.405450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:40.411371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:40.411826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:40.412603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:40.413045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:40.542799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.551283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.552775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:40.553933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bd7ffb6e-66ad-4f07-81da-43e0dfe14412 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.153706 Aug 27 04:08:40.554482 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 390/812] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:40 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:41.283679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:41.284289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:41.290155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:41.290635 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:41.291405 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:41.291849 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:41.349439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:41.357320 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bc2ee3f0-024d-4b2e-8566-26f54344277e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.077416 Aug 27 04:08:41.357999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 423/813] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:41 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:41.572482 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:41.573001 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:41.579481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:41.579935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:41.580712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:41.581212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:41.701370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:41.709784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:41.711320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:41.712464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-80c12009-3cdf-4b71-b2e4-bc8768dd053f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.143790 Aug 27 04:08:41.713023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 391/814] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:41 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:42.375071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:42.375612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:42.381481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:42.381936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:42.382728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:42.383192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:42.444726 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:42.452184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4d826c12-7177-43dd-9a7d-90c7a6cabe28 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.081913 Aug 27 04:08:42.452747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 424/815] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:42 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:42.733700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:42.734721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:42.743155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:42.743631 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:42.744422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:42.744893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:42.868441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:42.877416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:42.878934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:42.880167 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-518cb988-7989-42c3-b7a7-3d4d01731814 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.151502 Aug 27 04:08:42.880714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 392/816] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:42 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:43.469115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:43.469726 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:43.475740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:43.476216 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:43.476978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:43.477407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:43.535796 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:43.543421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e3f82c5b-96eb-4916-8440-177e50e1b70b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.077945 Aug 27 04:08:43.543970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 425/817] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:43 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:43.898687 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:43.899223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:43.906306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:43.906804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:43.907580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:43.908018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:44.034912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:44.042942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:44.044421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:44.045543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fe019f6c-14de-42b4-a280-bb87b848e613 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.150634 Aug 27 04:08:44.046097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 393/818] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:43 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:44.560628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:44.561215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:44.566992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:44.567440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:44.568208 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:44.568646 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:44.628729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:44.636130 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e2aa35a1-6a6a-47f3-9fcc-d6e8e5ed1b43 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.079496 Aug 27 04:08:44.636519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 426/819] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:44 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:45.062751 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:45.063359 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:45.069176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:45.069621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:45.070379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:45.070833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:45.191044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:45.199854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:45.201362 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:45.202510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5da6016c-6b9c-4ad2-beee-5dca1f9d465d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.143436 Aug 27 04:08:45.203080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 394/820] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:45 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:45.652911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:45.653454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:45.659504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:45.659957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:45.660728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:45.661165 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:45.719833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:45.726844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a71bbc62-9aa6-4740-af98-481a8a644fa7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.077703 Aug 27 04:08:45.727402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 427/821] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:45 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:46.220146 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:46.220752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:46.226577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:46.227039 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:46.227808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:46.228294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:46.353600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:46.362235 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:46.363748 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:46.364886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-46e9f60e-84dd-488d-b21a-39eae9d3bbc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.148408 Aug 27 04:08:46.365436 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 395/822] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:46 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:46.744017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:46.744611 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:46.750752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:46.751204 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:46.751965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:46.752396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:46.815922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:46.823703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5df96cf5-e7f1-4a75-abb7-ea442c620902 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1217 microversion: 2.1 time: 0.082874 Aug 27 04:08:46.824438 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 428/823] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:46 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:47.382677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:47.383216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:47.389189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:47.389642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:47.390679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:47.390918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:47.509483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:47.518577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:47.520079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:47.521219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2103e04a-48c2-478d-9772-a0a87ecf5bd4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.142407 Aug 27 04:08:47.521766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 396/824] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:47 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:47.840517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:47.841153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:47.846950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:47.847387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:47.848149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:47.848581 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:47.906755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:47.913956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ade45449-f62a-4771-a713-ffd2da9b9707 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1265 microversion: 2.1 time: 0.077299 Aug 27 04:08:47.916298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 429/825] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:47 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1265 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:48.540295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:48.540842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:48.547294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:48.547743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:48.548515 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:48.548946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:48.669945 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:48.678539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:48.680167 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:48.681336 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-28ee6c9a-7a57-4cab-a0ab-e7974d14d521 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.144909 Aug 27 04:08:48.681896 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 397/826] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:48 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:48.930771 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:48.935665 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:48.937767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:48.938228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:48.939039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:48.939477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:49.000329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:49.007603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-790ad814-ff88-49fa-9efe-fbd684c2ac1d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1265 microversion: 2.1 time: 0.080625 Aug 27 04:08:49.008162 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 430/827] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:48 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:49.700159 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:49.700793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:49.706709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:49.707162 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:49.707930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:49.708364 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:49.825591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:49.833712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:49.835241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:49.836376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5b40eff2-cbc1-4266-bfc6-823a376d4632 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.140682 Aug 27 04:08:49.836925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 398/828] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:49 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:50.024595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:50.025202 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:50.031581 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:50.032034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:50.032801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:50.033233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:50.092178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:50.099247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e2d02c8a-ba89-4978-9050-ed1effde6f27 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1265 microversion: 2.1 time: 0.078663 Aug 27 04:08:50.099802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 431/829] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:50 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1265 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:50.854843 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:50.855466 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:50.861280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:50.865923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:50.865923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:50.865923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:50.984604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:50.992753 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:50.994251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:50.996096 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a6437476-177e-4ef5-b56f-1b948665da18 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.145450 Aug 27 04:08:50.996643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 399/830] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:50 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:51.116187 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:51.116725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:51.123083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:51.123528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:51.124295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:51.124730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:51.187077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:51.194117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0dcfec14-bea9-4e00-9cbf-dec69aaa6c06 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1265 microversion: 2.1 time: 0.081624 Aug 27 04:08:51.194711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 432/831] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:51 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:52.014458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:52.015269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:52.021154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:52.021606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:52.022491 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:52.022962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:52.144816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:52.153846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:52.155458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:52.156595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9b951d4f-6278-4e08-8ffd-4ebed640ea88 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.147046 Aug 27 04:08:52.157396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 400/832] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:52 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:08:52.210795 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:52.211448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:52.217835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:52.219816 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:52.219816 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:52.219816 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:52.280812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:52.288163 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e7a1f205-aec8-43b7-92d5-b827f2490bd1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1273 microversion: 2.1 time: 0.081089 Aug 27 04:08:52.288725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 433/833] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:52 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1273 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:53.175617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:53.176670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:53.182627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:53.183047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:53.184012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:53.184441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:53.306801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:53.307786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:53.313526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:53.314146 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:53.315497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:53.315682 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:53.315881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:53.323791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:53.325299 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:53.326461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d4118e31-7b70-466f-9a18-cb493a3d3d0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.155229 Aug 27 04:08:53.327079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 401/834] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:53 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:53.437311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:53.444606 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-673c0395-0890-4522-a8b7-d9809b9782e6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.141503 Aug 27 04:08:53.445167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 434/835] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:53 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:08:53.978636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-c2f16ef0-898a-4878-8094-2be2442c0ddc req-bc00dda6-5da4-4633-88b2-2d462cd8b853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd151de1-a5c6-4733-9c89-80d0fc373682", "tag": "2b90baae-16c4-4c38-ad66-5230a5752ac3"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:08:53.980636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:08:53.980636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:08:53.990902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-c2f16ef0-898a-4878-8094-2be2442c0ddc req-bc00dda6-5da4-4633-88b2-2d462cd8b853 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:53.990902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-c2f16ef0-898a-4878-8094-2be2442c0ddc req-bc00dda6-5da4-4633-88b2-2d462cd8b853 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:54.008207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-c2f16ef0-898a-4878-8094-2be2442c0ddc req-bc00dda6-5da4-4633-88b2-2d462cd8b853 service nova] Creating event network-changed:2b90baae-16c4-4c38-ad66-5230a5752ac3 for instance dd151de1-a5c6-4733-9c89-80d0fc373682 on hv-cinder-80475 Aug 27 04:08:54.020694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-c2f16ef0-898a-4878-8094-2be2442c0ddc req-bc00dda6-5da4-4633-88b2-2d462cd8b853 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195545 Aug 27 04:08:54.021865 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 402/836] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:08:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:08:54.345498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:54.346095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:54.356248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:54.356695 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:54.357518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:54.357953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:54.462938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:54.463660 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:54.472868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:54.473609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:54.474931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:54.475641 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:54.492913 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:54.502603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:54.504125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:54.505465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-248151d2-70e3-48ce-89e0-a42dc623fa8e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.164487 Aug 27 04:08:54.506030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 435/837] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:54 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:54.826097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:54.833520 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9fbe366a-e6fc-425d-92a5-4eee173c9c26 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.374696 Aug 27 04:08:54.834085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 403/838] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:54 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:08:55.524484 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:55.525054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:55.531084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:55.531529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:55.532325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:55.532783 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:55.652284 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:55.660406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:55.661900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:55.663063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-64a9e42e-3ce4-4294-a16d-560937097ffb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.142689 Aug 27 04:08:55.663613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 436/839] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:55 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:55.850708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:55.851254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:55.857927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:55.858442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:55.859244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:55.859682 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:55.982338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:55.989486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d6eaff35-7de4-4adb-a907-8a2f05fd3143 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.142560 Aug 27 04:08:55.990054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 404/840] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:55 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:56.681101 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:56.681700 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:56.687500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:56.687949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:56.688703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:56.689140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:56.809717 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:56.817998 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:56.819636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:56.820755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-24e541b4-cac1-4b36-bcb6-955d68969620 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.143386 Aug 27 04:08:56.821303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 437/841] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:56 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:57.006919 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:57.007565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:57.014858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:57.015337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:57.016136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:57.016605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:57.137033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:57.144230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fb33298d-7593-4ecb-bf2b-3770b3d2ba6b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.141130 Aug 27 04:08:57.144791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 405/842] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:57 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:57.840026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:57.840563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:57.846406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:57.846875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:57.847644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:57.848072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:57.972537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:57.981478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:57.983151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:57.984287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7c3d3c86-5dc7-4d8c-bc24-6fa0a5beadcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.148735 Aug 27 04:08:57.984846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 438/843] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:57 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:58.159844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:58.160457 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:58.166313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:58.167566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:58.168478 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:58.168923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:58.284035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:58.291091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-51227197-2d39-47fd-a8e6-147b1501e746 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.134893 Aug 27 04:08:58.292197 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 406/844] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:58 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:08:59.002794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:59.003571 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:59.009589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:59.010786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:59.011719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:59.012489 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:59.138495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:59.146812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:59.148360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:59.149486 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-61ad6f2c-a752-4801-8de5-f4c3cb17cb3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.150610 Aug 27 04:08:59.150043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 439/845] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:08:58 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:08:59.308433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:08:59.309197 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:08:59.314997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:59.315447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:59.316228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:08:59.316659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:08:59.441934 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:08:59.449784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-485db8b6-2a60-4dc4-87df-f905855f31f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.145463 Aug 27 04:08:59.456053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 407/846] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:08:59 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:00.169644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:00.170247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:00.176462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:00.176904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:00.177668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:00.178096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:00.303244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:00.312603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:00.314321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:00.315530 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-df22990d-4de2-4223-8b39-372577c18480 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.150402 Aug 27 04:09:00.316093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 440/847] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:00 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:00.466625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:00.467183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:00.472964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:00.479722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:00.479722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:00.479722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:00.596084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:00.603569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-601528db-87c2-48fa-b606-da02a71e5297 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.140685 Aug 27 04:09:00.604695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 408/848] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:00 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:01.333287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:01.333898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:01.340312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:01.341022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:01.341778 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:01.342219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:01.469008 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:01.477377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:01.478995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:01.480271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-acf31f15-dda2-4945-8162-779248353bab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.150802 Aug 27 04:09:01.481162 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 441/849] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:01 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:01.620286 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:01.620908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:01.636373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:01.636373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:01.636373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:01.636373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:01.636979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-400f1f96-6eab-40ef-a479-0016017560e2 req-41553db1-9fb3-4fdd-b9b9-be41d7a60530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd151de1-a5c6-4733-9c89-80d0fc373682", "name": "network-vif-plugged", "status": "completed", "tag": "2b90baae-16c4-4c38-ad66-5230a5752ac3"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:01.636979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:09:01.636979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:09:01.637864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-400f1f96-6eab-40ef-a479-0016017560e2 req-41553db1-9fb3-4fdd-b9b9-be41d7a60530 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:01.638313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-400f1f96-6eab-40ef-a479-0016017560e2 req-41553db1-9fb3-4fdd-b9b9-be41d7a60530 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:01.649254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-400f1f96-6eab-40ef-a479-0016017560e2 req-41553db1-9fb3-4fdd-b9b9-be41d7a60530 service nova] Creating event network-vif-plugged:2b90baae-16c4-4c38-ad66-5230a5752ac3 for instance dd151de1-a5c6-4733-9c89-80d0fc373682 on hv-cinder-80475 Aug 27 04:09:01.654978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-400f1f96-6eab-40ef-a479-0016017560e2 req-41553db1-9fb3-4fdd-b9b9-be41d7a60530 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084702 Aug 27 04:09:01.655558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 409/850] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:09:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:01.755095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:01.762694 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-26e1e21b-d366-4810-9dc9-d66f15fa8482 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.146504 Aug 27 04:09:01.763256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 442/851] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:01 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:09:02.499900 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:02.500595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:02.506529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:02.507019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:02.507787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:02.508223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:02.634506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:02.642999 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:02.644500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:02.645632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dd2998a1-ca09-4fb1-9627-3fc13472cb7f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.150978 Aug 27 04:09:02.646184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 410/852] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:02 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:02.779213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:02.779851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:02.785670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:02.786134 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:02.786959 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:02.787402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:02.909045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:02.916194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e0ebd827-b5a2-4150-8cf0-24ad0c1c07f4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.141208 Aug 27 04:09:02.917450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 443/853] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:02 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:03.663453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:03.664009 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:03.670391 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:03.670629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-e744563d-cadf-468c-8903-068cb2cda014 req-ebee078d-2aaf-41fe-91c7-142eaf66e572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "name": "network-vif-plugged", "status": "completed", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:03.671244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:03.672018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:03.672160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:09:03.672160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:09:03.672977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:03.680473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-e744563d-cadf-468c-8903-068cb2cda014 req-ebee078d-2aaf-41fe-91c7-142eaf66e572 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:03.681224 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-e744563d-cadf-468c-8903-068cb2cda014 req-ebee078d-2aaf-41fe-91c7-142eaf66e572 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:03.693914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-e744563d-cadf-468c-8903-068cb2cda014 req-ebee078d-2aaf-41fe-91c7-142eaf66e572 service nova] Creating event network-vif-plugged:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:09:03.700339 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-e744563d-cadf-468c-8903-068cb2cda014 req-ebee078d-2aaf-41fe-91c7-142eaf66e572 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033293 Aug 27 04:09:03.701196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 444/854] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:09:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:03.810060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:03.823550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:03.825045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:03.826181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-60a4c62f-6837-44ac-919a-64cb36ce4dbc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.166660 Aug 27 04:09:03.826774 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 411/855] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:03 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:03.934812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:03.935501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:03.941472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:03.941919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:03.942704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:03.943135 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:04.094948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:04.102299 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-80e8b64e-9b83-455f-855b-5e682fe8fe49 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1313 microversion: 2.1 time: 0.172240 Aug 27 04:09:04.102888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 445/856] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:03 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:04.844859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:04.845463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:04.851239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:04.851689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:04.852448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:04.852880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:04.977289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:04.985740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:04.987288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:04.988430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e9856af0-f64d-4d20-a96e-45db2e277a5d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.147225 Aug 27 04:09:04.988988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 412/857] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:04 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:05.120044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:05.120693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:05.126404 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:05.126889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:05.127661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:05.128093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:05.246066 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:05.253178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-83c94403-d818-4475-b904-3352648d1daf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1497 microversion: 2.1 time: 0.137333 Aug 27 04:09:05.253744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 446/858] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:05 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1497 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:06.006687 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:06.007580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:06.013487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:06.013931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:06.014726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:06.015157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:06.134144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:06.142581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:06.144088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:06.145222 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-07504748-8d4e-48cf-80e3-39b6b0e0198e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.142220 Aug 27 04:09:06.145777 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 413/859] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:06 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:07.165047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:07.165695 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:07.172066 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:07.172509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:07.173272 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:07.173702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:07.294508 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:07.302894 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:07.304372 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:07.305494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d98a005b-d1a0-4306-9048-abc5bf2d9aef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.144225 Aug 27 04:09:07.306035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 447/860] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:07 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:08.324277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:08.324890 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:08.331191 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:08.331642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:08.332410 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:08.332842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:08.464341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:08.473996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:08.475539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:08.476711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3f90284d-2388-47e5-9625-0cada6159c4e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.156352 Aug 27 04:09:08.477279 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 414/861] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:08 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:08.840201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:08.840771 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:08.847689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:08.848175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:08.848985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:08.849428 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:08.875659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:09:09.185996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-16e18f3a-b60c-4bd0-9241-4a91b1e59142 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "DELETE /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 204 len: 0 microversion: 2.1 time: 0.349918 Aug 27 04:09:09.186836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 448/862] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:09:08 2021] DELETE /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:09:09.194655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:09.195257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:09.201886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:09.202331 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:09.203130 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:09.203561 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:09.335417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:09.344612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-95e86730-770a-4229-8561-653cb56de060 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1503 microversion: 2.1 time: 0.153469 Aug 27 04:09:09.345200 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 415/863] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:09 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:09.495992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:09.496721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:09.502698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:09.503153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:09.503926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:09.504363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:09.639298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:09.648662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:09.650153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:09.651446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-99815405-9cf3-4f09-88d8-d037781b8d6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.159751 Aug 27 04:09:09.652003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 449/864] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:09 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:10.362260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:10.362938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:10.370251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:10.370765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:10.372165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:10.372611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:10.531120 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:10.538696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-93decbe3-3600-4791-a2ce-bcc8594f6fcf tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1503 microversion: 2.1 time: 0.180896 Aug 27 04:09:10.539264 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 416/865] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:10 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:10.669699 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:10.670312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:10.681340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:10.682394 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:10.688532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:10.688994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:10.826291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:10.834703 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:10.836206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:10.837447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-64146848-a609-4f53-8258-29c1ed20804d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.172120 Aug 27 04:09:10.840470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 450/866] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:10 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:11.557145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:11.559267 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:11.564259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:11.564719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:11.565514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:11.565944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:11.720156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:11.730977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d548577f-9000-4d80-a193-be4e8f33fc2e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1503 microversion: 2.1 time: 0.177684 Aug 27 04:09:11.731841 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 417/867] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:11 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:11.860385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:11.891569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:11.891569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:11.891569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:11.891569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:11.892291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:12.003075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:12.012426 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:12.013925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:12.015104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-49f53295-0125-4320-96da-9c52321034cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1807 microversion: 2.20 time: 0.159402 Aug 27 04:09:12.015659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 451/868] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:11 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:09:12.269771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-3789a415-9782-481c-93b3-ebb684dcf9c0 req-d7baebdd-0ad1-4f07-990b-7c9951f7cdb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd151de1-a5c6-4733-9c89-80d0fc373682", "name": "network-vif-deleted", "tag": "2b90baae-16c4-4c38-ad66-5230a5752ac3"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:12.271608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:09:12.271608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:09:12.278852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-3789a415-9782-481c-93b3-ebb684dcf9c0 req-d7baebdd-0ad1-4f07-990b-7c9951f7cdb7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:12.279297 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-3789a415-9782-481c-93b3-ebb684dcf9c0 req-d7baebdd-0ad1-4f07-990b-7c9951f7cdb7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:12.291942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-3789a415-9782-481c-93b3-ebb684dcf9c0 req-d7baebdd-0ad1-4f07-990b-7c9951f7cdb7 service nova] Creating event network-vif-deleted:2b90baae-16c4-4c38-ad66-5230a5752ac3 for instance dd151de1-a5c6-4733-9c89-80d0fc373682 on hv-cinder-80475 Aug 27 04:09:12.297804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-3789a415-9782-481c-93b3-ebb684dcf9c0 req-d7baebdd-0ad1-4f07-990b-7c9951f7cdb7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031603 Aug 27 04:09:12.298486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 418/869] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:09:12.747871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:12.748479 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:12.754623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:12.755115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:12.755896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:12.756337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:12.789615 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:12.790062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:12.790512 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lazy-loading 'fault' on Instance uuid dd151de1-a5c6-4733-9c89-80d0fc373682 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:09:12.831480 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:12.839305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-489dec90-8f9e-4839-92d7-6d18ecb53d0c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 200 len: 1303 microversion: 2.1 time: 0.095698 Aug 27 04:09:12.839933 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 452/870] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:12 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:13.033783 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:13.034531 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:13.041682 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:13.042334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:13.043271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:13.043963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:13.174370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:13.183509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:13.184997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:13.186205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3eee72c6-e861-4bef-900f-0b9668282fa0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1794 microversion: 2.20 time: 0.156500 Aug 27 04:09:13.186729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 419/871] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:09:13 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1794 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:09:13.856538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:13.857151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: dd151de1-a5c6-4733-9c89-80d0fc373682] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:13.863226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:13.863954 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:13.865245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:13.865974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:13.887464 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] HTTP exception thrown: Instance dd151de1-a5c6-4733-9c89-80d0fc373682 could not be found. Aug 27 04:09:13.888050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Returning 404 to user: Instance dd151de1-a5c6-4733-9c89-80d0fc373682 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:09:13.888995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8fa21ea7-4052-46e6-8eb4-423c44cf8e78 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682" status: 404 len: 111 microversion: 2.1 time: 0.036967 Aug 27 04:09:13.889548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 453/872] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:13 2021] GET /compute/v2.1/servers/dd151de1-a5c6-4733-9c89-80d0fc373682 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:09:14.004025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-585292510", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "3b08d8a7-8602-418e-b250-eac0cd152297"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:14.061192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] validate_networks() for [('3b08d8a7-8602-418e-b250-eac0cd152297', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:09:14.448410 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:09:14.448799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:09:14.449558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:09:14.450017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:09:14.450439 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:09:14.459222 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:14.459691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:14.460558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:14.460974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:14.481415 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Getting quotas for project a65ba74164e2464cab37a8459816ebab. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:09:14.494006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Getting quotas for user bc5d70235d054703a69d76fd54daf683 and project a65ba74164e2464cab37a8459816ebab. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:09:14.506257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:09:14.508603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:09:14.644551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4eb40f92-4285-4c81-9ad6-d3a23bd8320f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646761 Aug 27 04:09:14.645126 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 420/873] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:09:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:09:14.659002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6051e373-c212-4226-930b-33de655d97c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:14.659002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6051e373-c212-4226-930b-33de655d97c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:14.742683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6051e373-c212-4226-930b-33de655d97c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:14.750413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6051e373-c212-4226-930b-33de655d97c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1213 microversion: 2.1 time: 0.099255 Aug 27 04:09:14.751557 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 454/874] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:14 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:15.768173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:15.771316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:15.774991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:15.775508 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:15.776420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:15.776782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:15.846242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:15.854316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-95028a80-de7b-433d-b01d-cb420377cfc0 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1217 microversion: 2.1 time: 0.089281 Aug 27 04:09:15.855005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 421/875] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:15 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:16.872661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:16.873214 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:16.879367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:16.879833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:16.880763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:16.881290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:16.951921 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:16.956880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6a7e5819-674c-4a4f-9af3-f1c7e558b4ed tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1265 microversion: 2.1 time: 0.089053 Aug 27 04:09:16.967191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 455/876] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:16 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:17.974583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:17.975157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:17.981577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:17.982018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:17.982820 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:17.983269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:18.111159 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:18.118346 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6c957776-fc9c-44f9-9408-aed388290144 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.147693 Aug 27 04:09:18.119003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 422/877] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:17 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:19.136050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:19.136759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:19.143372 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:19.143910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:19.144771 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:19.145277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:19.280991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:19.289475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9e89a871-715a-4227-8821-f475e17bbdce tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.157658 Aug 27 04:09:19.290194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 456/878] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:19 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:19.341491 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-1da009c2-2db2-4ae9-b50e-83f1ef66ad9c req-5f16f1c9-48b1-4ed9-bd01-110996423c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586ca828-ae61-4d73-b360-84b2bd8dade8", "tag": "f3f0df86-1325-4dce-a6ff-7913d05dde16"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:19.345411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:09:19.345411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:09:19.351171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-1da009c2-2db2-4ae9-b50e-83f1ef66ad9c req-5f16f1c9-48b1-4ed9-bd01-110996423c0f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:19.351888 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-1da009c2-2db2-4ae9-b50e-83f1ef66ad9c req-5f16f1c9-48b1-4ed9-bd01-110996423c0f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:19.364722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-1da009c2-2db2-4ae9-b50e-83f1ef66ad9c req-5f16f1c9-48b1-4ed9-bd01-110996423c0f service nova] Creating event network-changed:f3f0df86-1325-4dce-a6ff-7913d05dde16 for instance 586ca828-ae61-4d73-b360-84b2bd8dade8 on hv-cinder-80475 Aug 27 04:09:19.369973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-1da009c2-2db2-4ae9-b50e-83f1ef66ad9c req-5f16f1c9-48b1-4ed9-bd01-110996423c0f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032671 Aug 27 04:09:19.370854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 423/879] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:09:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:20.307608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:20.308249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:20.314288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:20.314779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:20.315560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:20.315995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:20.446698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:20.454386 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-961e6a48-109c-47e1-9905-f5ce12c6f9c6 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.150833 Aug 27 04:09:20.455143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 457/880] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:20 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:21.472864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:21.473558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:21.479838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:21.480767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:21.481531 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:21.481965 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:21.604602 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:21.612064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-77546c42-64ac-477d-bbd8-2dc768cd36ef tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.143397 Aug 27 04:09:21.612641 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 424/881] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:21 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:22.628629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:22.629231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:22.635948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:22.636554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:22.637416 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:22.638044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:22.773291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:22.781319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7f73c247-3fe5-4741-8214-ee369703398c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.156474 Aug 27 04:09:22.788278 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 458/882] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:22 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:23.797706 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:23.798337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:23.804556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:23.805000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:23.805767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:23.806196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:23.929787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:23.937940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7e4c9391-0150-44ed-ae5f-e17291e176fb tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.144061 Aug 27 04:09:23.938744 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 425/883] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:23 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:24.955267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:24.955878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:24.962279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:24.962752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:24.963674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:24.963955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:25.092553 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:25.100350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-196615d7-0622-49d3-94fc-13deb8fc7a25 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.148773 Aug 27 04:09:25.100915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 459/884] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:24 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:26.117349 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:26.117969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:26.123826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:26.124256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:26.125018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:26.125450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:26.258244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:26.266426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6959aebb-753a-42cd-af79-15ed41823613 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.152862 Aug 27 04:09:26.267021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 426/885] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:26 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:27.283271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:27.283878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:27.289741 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:27.290190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:27.291038 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:27.291476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:27.421127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:27.433595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-69ad5a69-aa32-40f9-aed7-56f3407b5584 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.153892 Aug 27 04:09:27.435494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 460/886] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:27 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:28.452172 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:28.452808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:28.458796 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:28.459240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:28.460000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:28.460429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:28.584260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:28.591854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f92f8dd5-8a16-4a70-991b-8978cda2f68c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.143666 Aug 27 04:09:28.592415 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 427/887] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:28 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:29.575497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-42d9d5a8-febe-4607-968d-f094de64c5c3 req-25f18426-7f56-47b7-b5ad-b21a645959db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca828-ae61-4d73-b360-84b2bd8dade8", "name": "network-vif-plugged", "status": "completed", "tag": "f3f0df86-1325-4dce-a6ff-7913d05dde16"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:29.577081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:09:29.577081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:09:29.584103 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-42d9d5a8-febe-4607-968d-f094de64c5c3 req-25f18426-7f56-47b7-b5ad-b21a645959db service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:29.584589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-42d9d5a8-febe-4607-968d-f094de64c5c3 req-25f18426-7f56-47b7-b5ad-b21a645959db service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:29.598298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-42d9d5a8-febe-4607-968d-f094de64c5c3 req-25f18426-7f56-47b7-b5ad-b21a645959db service nova] Creating event network-vif-plugged:f3f0df86-1325-4dce-a6ff-7913d05dde16 for instance 586ca828-ae61-4d73-b360-84b2bd8dade8 on hv-cinder-80475 Aug 27 04:09:29.603896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-42d9d5a8-febe-4607-968d-f094de64c5c3 req-25f18426-7f56-47b7-b5ad-b21a645959db service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032325 Aug 27 04:09:29.605010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 461/888] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:09:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:29.608972 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:29.609643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:29.617319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:29.617319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:29.617319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:29.617319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:29.740513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:29.748500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7d33bd4e-84f7-430a-ac91-dfe3c7a5de8d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.143830 Aug 27 04:09:29.753954 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 428/889] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:29 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:09:30.770193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:30.770951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:30.778150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:30.778629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:30.779405 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:30.779839 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:30.906910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:30.914289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4b693e94-9aeb-4e80-8626-7ff221ee7b9c tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.148302 Aug 27 04:09:30.914886 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 462/890] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:30 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:09:31.932284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:31.933042 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:31.939683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:31.940101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:31.940902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:31.941342 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:32.075513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:32.082885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-56b92c3a-d462-4126-b7fd-04752bc2124f tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1313 microversion: 2.1 time: 0.154411 Aug 27 04:09:32.083518 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 429/891] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:31 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:33.100643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:33.101254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:33.108223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:33.108682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:33.109460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:33.109908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:33.234948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:33.242336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5192217a-5e56-410e-9771-e5b6ea241f9e tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1497 microversion: 2.1 time: 0.145348 Aug 27 04:09:33.242934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 463/892] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:33 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:34.173271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:34.173805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:34.179860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:34.180325 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:34.181084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:34.181513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:34.207301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:09:34.511263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-80350618-b421-40bc-ba6a-70a32aa89f18 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "DELETE /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 204 len: 0 microversion: 2.1 time: 0.341234 Aug 27 04:09:34.512341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 430/893] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:09:34 2021] DELETE /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:09:34.520218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:34.520802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:34.526782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:34.527268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:34.528642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:34.529105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:34.658754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:34.665950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2ed2a120-0a94-44b0-aa28-d59f902e88c9 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1503 microversion: 2.1 time: 0.149372 Aug 27 04:09:34.666515 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 464/894] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:34 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:35.685117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:35.685849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:35.691824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:35.692278 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:35.693050 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:35.693485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:35.816608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:35.825502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cc70e66c-87d2-440a-b5a6-30694c0b6c3d tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1503 microversion: 2.1 time: 0.144371 Aug 27 04:09:35.826005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 431/895] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:35 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:36.842483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:36.843132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:36.849223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:36.849682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:36.850454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:36.850919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:36.970769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:36.978125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b8685af7-c160-44ff-959f-84ed64a0c3b1 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1503 microversion: 2.1 time: 0.139945 Aug 27 04:09:36.978721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 465/896] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:36 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1503 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:37.994853 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:37.995464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:38.001730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:38.002175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:38.002973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:38.003526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:38.128574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:38.135874 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-54b7513e-ffd7-4250-9848-3ae142376337 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1503 microversion: 2.1 time: 0.144669 Aug 27 04:09:38.136421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 432/897] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:37 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:39.153533 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:39.154249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:39.160152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:39.160596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:39.161361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:39.161791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:39.282647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:39.289757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c6f2960e-fcfb-481e-8768-bc10aa9d12e5 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1503 microversion: 2.1 time: 0.140488 Aug 27 04:09:39.290322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 466/898] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:39 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1503 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:40.307536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:40.308140 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:40.314316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:40.315274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:40.315681 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:40.316111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:40.444899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:40.466953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-84eeb887-c94c-42aa-9ad9-da8157ffb1ff tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1503 microversion: 2.1 time: 0.162319 Aug 27 04:09:40.467544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 433/899] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:40 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:40.828779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-4d228362-1cde-47aa-b9a2-fda0d2e2dacf req-5ea256c1-d522-4ca8-8706-7cc3406b87f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca828-ae61-4d73-b360-84b2bd8dade8", "name": "network-vif-deleted", "tag": "f3f0df86-1325-4dce-a6ff-7913d05dde16"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:40.837159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:09:40.837159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:09:40.837159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-4d228362-1cde-47aa-b9a2-fda0d2e2dacf req-5ea256c1-d522-4ca8-8706-7cc3406b87f7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:40.837440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-4d228362-1cde-47aa-b9a2-fda0d2e2dacf req-5ea256c1-d522-4ca8-8706-7cc3406b87f7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:40.848019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-4d228362-1cde-47aa-b9a2-fda0d2e2dacf req-5ea256c1-d522-4ca8-8706-7cc3406b87f7 service nova] Creating event network-vif-deleted:f3f0df86-1325-4dce-a6ff-7913d05dde16 for instance 586ca828-ae61-4d73-b360-84b2bd8dade8 on hv-cinder-80475 Aug 27 04:09:40.853137 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-4d228362-1cde-47aa-b9a2-fda0d2e2dacf req-5ea256c1-d522-4ca8-8706-7cc3406b87f7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028780 Aug 27 04:09:40.853721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 467/900] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:09:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:09:41.485247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:41.485862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:41.491822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:41.492499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:41.493037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:41.493470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:41.556712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:41.565049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6f1b8e0d-71d8-4ef6-9a66-d07bd2ca454b tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1298 microversion: 2.1 time: 0.084140 Aug 27 04:09:41.565614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 434/901] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:41 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1298 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:42.581952 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:42.582779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:42.588963 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:42.589363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:42.590127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:42.590572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:42.649759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:42.657269 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-34667a4e-9a6d-407a-9be9-86e8991606d4 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1298 microversion: 2.1 time: 0.079570 Aug 27 04:09:42.657832 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 468/902] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:42 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1298 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:43.673522 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:43.674115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:43.680636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:43.681086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:43.681883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:43.682308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:43.740895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:43.748045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-adf3e2d8-6158-4e6f-9798-b26bc4625003 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1298 microversion: 2.1 time: 0.078558 Aug 27 04:09:43.748598 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 435/903] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:43 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1298 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:44.765229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:44.765845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:44.771781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:44.772240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:44.773013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:44.773449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:44.805227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:44.805680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:44.806144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lazy-loading 'fault' on Instance uuid 586ca828-ae61-4d73-b360-84b2bd8dade8 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:09:44.844568 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:44.851716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b80c3540-f9d4-4f14-b6e2-d712b49d68df tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1303 microversion: 2.1 time: 0.090670 Aug 27 04:09:44.852276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 469/904] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:44 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:45.871713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:45.872786 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:45.880189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:45.880651 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:45.881441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:45.881881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:45.912756 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:45.913201 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:45.913698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lazy-loading 'fault' on Instance uuid 586ca828-ae61-4d73-b360-84b2bd8dade8 {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:09:45.951755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5d70235d054703a69d76fd54daf683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a65ba74164e2464cab37a8459816ebab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:45.959616 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7bd86e55-7565-476d-a640-102dcd9ffde3 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 200 len: 1303 microversion: 2.1 time: 0.093210 Aug 27 04:09:45.960182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 436/905] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:45 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:46.976194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:46.976805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] [instance: 586ca828-ae61-4d73-b360-84b2bd8dade8] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:46.982906 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:46.984028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:46.985023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:46.985491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:46.999013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] HTTP exception thrown: Instance 586ca828-ae61-4d73-b360-84b2bd8dade8 could not be found. Aug 27 04:09:46.999652 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] Returning 404 to user: Instance 586ca828-ae61-4d73-b360-84b2bd8dade8 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:09:47.000479 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a2c66aaa-5190-49cf-a11b-19801ccfc4f7 tempest-VolumesActionsTest-458025932 tempest-VolumesActionsTest-458025932-project] 10.222.0.73 "GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8" status: 404 len: 111 microversion: 2.1 time: 0.028074 Aug 27 04:09:47.001015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 470/906] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:46 2021] GET /compute/v2.1/servers/586ca828-ae61-4d73-b360-84b2bd8dade8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:09:48.711984 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:48.712582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:48.718920 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:48.719383 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:48.720161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:48.720603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:48.743611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lazy-loading 'flavor' on Instance uuid 882054ae-274e-4eeb-96d8-2b543f110b88 {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:09:49.067244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-14face34-9fd4-4e1f-851e-f8daa1e8a2c3 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "POST /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88/action" status: 202 len: 0 microversion: 2.1 time: 0.358682 Aug 27 04:09:49.067846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 437/907] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:09:48 2021] POST /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:09:49.075799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:49.077567 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:49.083889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:49.084337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:49.085117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:49.085550 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:49.206939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:49.214220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0c8e57e3-82bd-4b1e-aa5a-2fb14892322d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.142074 Aug 27 04:09:49.219887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 471/908] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:49 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:50.232556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:50.233749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:50.240124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:50.240588 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:50.241348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:50.241778 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:50.284618 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:09:50.285562 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:50.291470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:50.291923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:50.292701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:50.293138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:50.366830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:50.374038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-97c6e3ee-2c27-4754-8c4c-934ca1347a90 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.145560 Aug 27 04:09:50.374646 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 438/909] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:50 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:50.463112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-33b38385-f309-41ad-a86b-41d2d63408c8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/action" status: 202 len: 0 microversion: 2.1 time: 0.182193 Aug 27 04:09:50.463732 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 472/910] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:09:50 2021] POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:09:50.472097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:50.472852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:50.478712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:50.479159 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:50.481265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:50.481265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:50.601712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:50.609543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6ea7dbe5-da22-429d-b43f-4043d4e9c0c0 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1751 microversion: 2.1 time: 0.140975 Aug 27 04:09:50.610097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 439/911] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:50 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1751 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:51.392434 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:51.393086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:51.399073 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:51.399532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:51.400308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:51.400748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:51.523733 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:51.532232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-de4d6843-a06e-468b-9b2b-eb801634ae1a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.144507 Aug 27 04:09:51.532794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 473/912] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:51 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:51.628396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:51.629016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:51.634824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:51.635283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:51.636057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:51.636494 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:51.762276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:51.767099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6f9f1789-4fa3-4dde-8892-84eedd4f1868 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1751 microversion: 2.1 time: 0.143629 Aug 27 04:09:51.767664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 440/913] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:51 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1751 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:52.549398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:52.550018 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:52.556055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:52.556516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:52.557294 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:52.557736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:52.685073 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:52.693361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3991f7d6-c75a-4b0e-9b55-3a2920c00825 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.148200 Aug 27 04:09:52.693926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 474/914] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:52 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:52.784431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:52.785038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:52.790832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:52.791277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:52.792036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:52.792465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:52.931352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:52.940000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1646852e-2b5a-4f23-a561-9a2b5521af04 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1751 microversion: 2.1 time: 0.159464 Aug 27 04:09:52.942742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 441/915] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:52 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:53.711498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:53.712354 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:53.719029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:53.719509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:53.720311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:53.720751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:53.845453 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:53.852815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b1dc1ff2-30c5-4665-979d-24957f1f0eaa tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.145152 Aug 27 04:09:53.853371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 475/916] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:53 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:53.958028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:53.958661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:53.964589 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:53.964978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:53.965744 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:53.966178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:54.091590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:54.100764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f7a4aa5d-1dfc-47fe-af8f-f7b0b6daa51d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1751 microversion: 2.1 time: 0.146466 Aug 27 04:09:54.104722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 442/917] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:53 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1751 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:54.870842 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:54.876656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:54.877460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:54.877912 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:54.878718 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:54.879153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:55.019513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:55.026985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d4dc0da0-caa6-4f1b-93be-1fab55a85b19 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.160460 Aug 27 04:09:55.027563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 476/918] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:54 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:55.118310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:55.118965 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:55.125999 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:55.126447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:55.127329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:55.130028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:55.269216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:55.277149 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d283198e-b04a-43b1-9d19-83e451438245 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.162511 Aug 27 04:09:55.277715 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 443/919] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:55 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:56.044387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:56.045008 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:56.051889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:56.052334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:56.053102 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:56.053537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:56.177477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:56.184788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7d82933d-9b1b-4f6c-86c7-36eca82c503b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.144090 Aug 27 04:09:56.185353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 477/920] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:56 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:56.294598 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:56.295149 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:56.301692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:56.302135 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:56.302936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:56.303366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:56.426115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:56.434010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aeab81de-de33-4c82-87e9-42a468ea3c7b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.143155 Aug 27 04:09:56.434583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 444/921] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:56 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:57.202672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:57.203516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:57.209201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:57.209642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:57.210402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:57.210857 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:57.336838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:57.344472 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-24bd6cce-edc3-400b-b33e-15174bf36941 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.145651 Aug 27 04:09:57.345037 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 478/922] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:57 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:57.455047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:57.455650 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:57.461644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:57.462092 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:57.462893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:57.463330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:57.588969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:57.597148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f9eb734c-c9fb-4977-b559-67abfdf5da58 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.146543 Aug 27 04:09:57.597707 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 445/923] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:57 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:58.361630 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:58.362170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:58.367990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:58.368436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:58.369196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:58.369624 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:58.493939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:58.502074 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5b4b0b10-291e-4ebb-8096-c9e205bea1c6 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.144753 Aug 27 04:09:58.502656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 479/924] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:58 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:58.614702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:58.615216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:58.621036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:58.621476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:58.622230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:58.622688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:58.742871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:58.756918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0baf932f-b4c1-428a-9531-82076fd8dd86 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.146316 Aug 27 04:09:58.757788 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 446/925] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:58 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:59.519177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:59.519765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:59.525715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:59.526196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:59.527030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:59.527501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:59.649796 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:59.657725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-29fdb15e-f651-43f2-96ae-870c810acbb2 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.143186 Aug 27 04:09:59.658288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 480/926] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:59 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:09:59.775305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:09:59.775848 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:09:59.782852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:59.783375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:59.783977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:09:59.784411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:09:59.913495 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:09:59.921947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cdb48914-6ff5-4d90-bc45-f605ddd2ef60 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.149857 Aug 27 04:09:59.922550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 447/927] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:09:59 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:00.676366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:00.676985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:00.683083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:00.683538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:00.684369 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:00.684806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:00.811670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:00.820165 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-93e48281-2d51-44f3-86af-0b103594397e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.148768 Aug 27 04:10:00.820748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 481/928] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:00 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:00.941108 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:00.941674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:00.947574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:00.948032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:00.948796 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:00.949237 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:01.093500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:01.101800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4e4a2479-93a4-4119-a2a7-f560c6734fcd tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.165036 Aug 27 04:10:01.102543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 448/929] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:00 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:10:01.845529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:01.846825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:01.864367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:01.865622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:01.867840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:01.869132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:02.051696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:02.064368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-914d6b36-e284-4597-909a-a2797760aaa8 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.225774 Aug 27 04:10:02.065348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 482/930] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:01 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:02.120642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:02.121585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:02.128879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:02.129948 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:02.130944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:02.131689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:02.287742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:02.298324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3ea28bc4-1e90-42c0-a558-8f46df617336 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.181928 Aug 27 04:10:02.299175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 449/931] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:02 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:03.082909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:03.084164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:03.090406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:03.090998 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:03.091883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:03.092451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:03.238941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:03.249092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d288407a-0eb2-4e01-84b3-bd24e7ef1f47 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.170262 Aug 27 04:10:03.250977 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 483/932] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:03 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:03.316508 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:03.317295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:03.323527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:03.323976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:03.324756 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:03.325189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:03.474258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:03.483371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a1e4700f-162e-4856-ac74-1df460cf63d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.170732 Aug 27 04:10:03.484303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 450/933] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:03 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:04.270753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:04.271400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:04.277454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:04.277912 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:04.278724 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:04.279166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:04.415819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:04.423662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e61bd3da-5d07-45cf-96b9-e73f3e3c73da tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.156691 Aug 27 04:10:04.424235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 484/934] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:04 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:04.501443 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:04.501982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:04.508185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:04.508637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:04.509793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:04.509879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:04.660293 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:04.669027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7b641c0d-6ffd-4d13-bc5e-29aba3734083 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.171916 Aug 27 04:10:04.680091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 451/935] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:04 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:05.441538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:05.442731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:05.449829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:05.450292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:05.451122 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:05.451759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:05.597531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:05.605308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-294e1073-a187-4080-a506-02c4dd7e034e tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.168160 Aug 27 04:10:05.616823 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 485/936] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:05 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:05.687694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:05.689081 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:05.696528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:05.697122 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:05.698181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:05.698958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:05.846730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:05.854978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d17a258a-26c0-4206-9eec-1c0e2304db69 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.171080 Aug 27 04:10:05.855826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 452/937] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:05 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:10:06.624752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:06.625358 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:06.633173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:06.633728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:06.634816 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:06.635368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:06.778064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:06.786858 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2f099295-183d-4d4c-b6dc-f49cf88bd19f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.166428 Aug 27 04:10:06.789030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 486/938] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:06 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:06.871071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05368f9e-b724-4253-88eb-17bdbbcdc98a] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:10:06.875123 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:06.877567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:06.894501 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:06.894994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:06.895852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:06.896307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:07.056320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:07.068789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5877b506-1547-4009-9f4f-6d03e543d79d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.199312 Aug 27 04:10:07.078416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 453/939] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:06 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:07.806945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:07.808275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:07.812918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d549f506-4416-46b2-8a80-d941453b9595] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:10:07.816625 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:07.817283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:07.818079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:07.818517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:07.965011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:07.980212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6585a6cd-3258-4cc4-aa02-9c6bce045298 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.177572 Aug 27 04:10:07.980883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 487/940] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:07 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:08.026322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:10:08.026491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:10:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:10:08.087050 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:08.088290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:08.110656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:08.111363 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:08.112357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:08.113195 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:08.151996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] [05368f9e-b724-4253-88eb-17bdbbcdc98a] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 38622. Aug 27 04:10:08.298348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:08.308451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-494cbb8b-4b8b-4b6e-8a40-9a0b8846e502 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.225458 Aug 27 04:10:08.309011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 454/941] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:08 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:09.002051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:09.003329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:09.037353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:09.038219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:09.039283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:09.040160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:09.060276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] [d549f506-4416-46b2-8a80-d941453b9595] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 38630. Aug 27 04:10:09.190529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:09.202950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-12d3b2b1-3feb-460f-849b-b27e77c22d2f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.207459 Aug 27 04:10:09.203658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 488/942] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:08 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:09.326462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:09.328897 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:09.335380 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:09.336085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:09.337802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:09.338408 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:09.545218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:09.557692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-82c7c03a-d3e0-4d8c-8a8a-c2ce994b18ad tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.232971 Aug 27 04:10:09.558898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 455/943] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:09 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:10.221614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:10.222353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:10.228340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:10.228791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:10.229573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:10.230008 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:10.375164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:10.383154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c2d146ef-77e0-416d-8935-ee7d6a5f0b84 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.166812 Aug 27 04:10:10.383743 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 489/944] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:10 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:10.587476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:10.588012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:10.594830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:10.595281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:10.596055 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:10.596541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:10.724770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:10.734590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2b61223a-3312-4f76-bf35-7ec24aca4408 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.150340 Aug 27 04:10:10.735337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 456/945] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:10 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:11.400967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:11.402220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:11.408314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:11.408991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:11.409775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:11.410373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:11.546367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:11.555295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-539ea6ea-223c-4c41-b6f7-3d8daa3c5077 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.158125 Aug 27 04:10:11.565941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 490/946] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:11 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:11.752405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:11.753026 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:11.759093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:11.759547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:11.760330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:11.760958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:11.919003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:11.930731 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7e057bad-a4f3-423b-ae23-50e6850193e2 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.182729 Aug 27 04:10:11.941909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 457/947] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:11 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:12.572854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:12.573628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:12.580603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:12.581058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:12.581843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:12.582509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:12.741230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:12.756577 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-51d1294f-2543-476e-8c8c-3f157fd54223 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.187366 Aug 27 04:10:12.769606 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 491/948] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:12 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:12.949301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:12.949999 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:12.957264 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:12.957717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:12.958527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:12.958984 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:13.096773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:13.104843 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-727a9c08-d835-419a-8a05-9e64d9d52bcb tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.159176 Aug 27 04:10:13.105441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 458/949] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:12 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:13.776257 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:13.776877 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:13.783298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:13.784105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:13.785112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:13.785748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:13.917340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:13.926671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d8b9f948-7a5e-4b1b-a7a2-9af2612dfd73 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.153881 Aug 27 04:10:13.927271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 492/950] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:13 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:14.122801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:14.123351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:14.129787 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:14.130530 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:14.131700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:14.132398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:14.276368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:14.286442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fda45441-a329-47b0-9171-a869480e71d8 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.167482 Aug 27 04:10:14.297453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 459/951] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:14 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:14.943629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:14.944411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:14.950652 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:14.954327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:14.954327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:14.954327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:15.102473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:15.114461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c5863ac6-041b-48d6-b0f6-34e322e2f7e7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.174410 Aug 27 04:10:15.115450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 493/952] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:14 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:10:15.305117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:15.305724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:15.313216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:15.313667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:15.314716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:15.315262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:15.455142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:15.467126 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-472d053b-a038-4480-8517-fc650cececf3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.166049 Aug 27 04:10:15.468555 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 460/953] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:15 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:16.156335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:16.156926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:16.163581 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:16.164035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:16.164836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:16.165276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:16.362092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:16.362092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a79507f9-9fef-4e2d-985a-770997b7c65c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.196554 Aug 27 04:10:16.362092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 494/954] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:16 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:16.486076 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:16.486718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:16.492745 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:16.493191 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:16.493962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:16.494401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:16.632722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:16.641213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-06835d91-d386-40a2-bf72-1344d22be414 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.160014 Aug 27 04:10:16.641771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 461/955] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:16 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:17.378670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:17.379316 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:17.385309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.385760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.386748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.387327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.517670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:17.525028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-711c1b7c-f838-4867-a3a7-38d5cd106987 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1572 microversion: 2.1 time: 0.151505 Aug 27 04:10:17.525600 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 495/956] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:17 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:17.542294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:17.542876 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:17.549150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.549600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.550371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.550844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.658193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:17.658875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:17.673119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.673119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.673119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.673119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.796949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:17.805080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6c23da16-cbf0-4304-9158-da26f82f337a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.151367 Aug 27 04:10:17.805648 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 496/957] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:17 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:10:17.890716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f65041e9-4ce9-4519-a5b1-e8473fe2ad8c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "POST /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88/action" status: 202 len: 0 microversion: 2.1 time: 0.351345 Aug 27 04:10:17.892007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 462/958] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:10:17 2021] POST /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:10:17.899739 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:17.901461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:17.908984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.915671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:17.915671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:17.915671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:18.002490 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-9888f41e-7ad4-46ca-a2bb-2c77878282eb req-38b50098-23d5-4fcb-a00c-eee80a9131a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "name": "network-vif-unplugged", "status": "completed", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:18.004402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:10:18.004402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:10:18.012515 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-9888f41e-7ad4-46ca-a2bb-2c77878282eb req-38b50098-23d5-4fcb-a00c-eee80a9131a8 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:18.019422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-9888f41e-7ad4-46ca-a2bb-2c77878282eb req-38b50098-23d5-4fcb-a00c-eee80a9131a8 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:18.033873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-9888f41e-7ad4-46ca-a2bb-2c77878282eb req-38b50098-23d5-4fcb-a00c-eee80a9131a8 service nova] Creating event network-vif-unplugged:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:10:18.033873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-9888f41e-7ad4-46ca-a2bb-2c77878282eb req-38b50098-23d5-4fcb-a00c-eee80a9131a8 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044369 Aug 27 04:10:18.034450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 463/959] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:10:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:10:18.054355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:18.062996 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3a54977f-88c1-4490-bd4d-090f90bfe1cc tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1580 microversion: 2.1 time: 0.166749 Aug 27 04:10:18.063572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 497/960] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:17 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1580 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:18.821797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:18.822513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:18.829483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:18.830041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:18.830701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:18.831132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:18.963903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:18.972438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-41c467f4-4e04-415f-b36c-b5e68f14d22e tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.154627 Aug 27 04:10:18.973004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 464/961] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:18 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:19.080928 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:19.081464 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:19.087775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:19.088310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:19.089194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:19.089633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:19.220426 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:19.228374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dac07627-67d9-4f8d-82c4-d4dbb339ad0f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1522 microversion: 2.1 time: 0.151824 Aug 27 04:10:19.234960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 498/962] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:19 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:19.990156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:19.990801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:19.996877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:19.997329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:19.999071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:19.999071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:20.128099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:20.140071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1d237f66-6411-4198-9fc3-c574ec54762a tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.153420 Aug 27 04:10:20.140755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 465/963] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:19 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:20.246024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:20.246588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:20.252384 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:20.252840 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:20.253621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:20.254061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:20.378657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:20.386076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4803305b-1694-4d5f-8f18-196732e0548a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1522 microversion: 2.1 time: 0.143834 Aug 27 04:10:20.387100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 499/964] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:20 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:21.158713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:21.159472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:21.168184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:21.168643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:21.169423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:21.169852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:21.304924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:21.318409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-399125a4-1f81-49eb-b3c6-81631268153c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1756 microversion: 2.1 time: 0.164175 Aug 27 04:10:21.332164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 466/965] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:21 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:21.405022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:21.406374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:21.412285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:21.412742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:21.413524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:21.413967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:21.549870 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:21.557569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-752b9cb6-5f89-4d14-82bd-e5d7c7e3c185 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.156503 Aug 27 04:10:21.558145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 500/966] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:21 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:22.348882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:22.348882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:22.348882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:22.348882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:22.349979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:22.355492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:22.576060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:22.579225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:22.591951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:22.592403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:22.594023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:22.594640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:22.613708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:22.628867 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-684e8c43-1e2f-43af-9152-d414f2cb669d tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1759 microversion: 2.1 time: 0.292356 Aug 27 04:10:22.629534 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 467/967] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:22 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1759 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:22.730697 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:22.740950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aa27c71a-34ba-40f8-bd8c-56ad8abfd689 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.168740 Aug 27 04:10:22.741664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 501/968] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:22 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:23.760686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:23.761286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:23.767000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:23.767551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:23.768184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:23.768612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:23.890083 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:23.898537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8cc433e4-c6b9-4851-8df0-b23ddddd5a6a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.141536 Aug 27 04:10:23.899138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 468/969] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:23 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:24.916976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:24.917699 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:24.924443 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:24.925146 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:24.925935 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:24.926681 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:25.063051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:25.070377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-425b3462-e3ef-4bec-9e23-7964d6120a1c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.157108 Aug 27 04:10:25.071041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 502/970] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:24 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:26.087579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:26.088218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:26.094121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:26.094546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:26.095356 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:26.095793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:26.218981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:26.226703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cebb6996-7a61-4f7e-8fbe-9418430864ef tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.142996 Aug 27 04:10:26.227435 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 469/971] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:26 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:27.244904 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:27.245811 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:27.252653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:27.253190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:27.254050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:27.254568 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:27.619888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:27.629252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-33c5a6f6-f4d0-4076-be35-d76af775eb1d tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.388229 Aug 27 04:10:27.629837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 503/972] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:27 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:28.646417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:28.647090 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:28.653236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:28.653698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:28.654473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:28.655005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:28.790394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:28.799031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f1aff904-8fcd-4329-9a23-d57de4b35b4c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.156358 Aug 27 04:10:28.799686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 470/973] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:28 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:29.817014 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:29.817846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:29.823664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:29.824386 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:29.825356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:29.825981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:29.954531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:29.962086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-27cacd27-fb5f-43a7-bb46-b61d89997070 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.148936 Aug 27 04:10:29.962869 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 504/974] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:29 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:30.980846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:30.981461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:30.988623 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:30.989107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:30.989886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:30.990320 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:31.119725 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:31.128052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c9a7d73d-c3a0-4030-8bb3-be7375d7657a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.151030 Aug 27 04:10:31.128627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 471/975] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:30 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:32.145125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:32.145880 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:32.152062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:32.152617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:32.153470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:32.153908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:32.280664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:32.289412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f6bcd97a-8240-4134-82b2-ef36829caf9b tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.148231 Aug 27 04:10:32.290087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 505/976] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:32 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:33.307565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:33.308317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:33.314863 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:33.315312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:33.316087 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:33.316513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:33.442642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:33.449745 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c052ea20-67ad-4e44-990a-f047c2ca7842 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.146091 Aug 27 04:10:33.450304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 472/977] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:33 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:34.471563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:34.472198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:34.478201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:34.478720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:34.479478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:34.480006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:34.605559 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:34.613357 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-44cfc468-53c0-421a-8d7e-00125fd06c66 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.145578 Aug 27 04:10:34.613925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 506/978] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:34 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:35.631959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:35.632572 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:35.638761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:35.639228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:35.640013 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:35.643464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:35.766785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:35.775827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0fb1de71-ba02-4c25-a8fe-033bc740f809 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.148056 Aug 27 04:10:35.777425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 473/979] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:35 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:36.117976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-fdbaa61f-db04-4fe2-a89c-786b188fa416 req-8ed45acc-3554-48ea-94dc-55672818477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "name": "network-vif-plugged", "status": "completed", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:10:36.119572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:10:36.119572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:10:36.126219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-fdbaa61f-db04-4fe2-a89c-786b188fa416 req-8ed45acc-3554-48ea-94dc-55672818477e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:36.129267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-fdbaa61f-db04-4fe2-a89c-786b188fa416 req-8ed45acc-3554-48ea-94dc-55672818477e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:36.138080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-fdbaa61f-db04-4fe2-a89c-786b188fa416 req-8ed45acc-3554-48ea-94dc-55672818477e service nova] Creating event network-vif-plugged:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:10:36.143659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-fdbaa61f-db04-4fe2-a89c-786b188fa416 req-8ed45acc-3554-48ea-94dc-55672818477e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029236 Aug 27 04:10:36.144334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 507/980] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:10:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:10:36.793020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:36.793632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:36.800212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:36.800756 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:36.801794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:36.802232 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:36.927794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:36.935382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-af40e0db-f280-43b0-93c0-b82223543304 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.146018 Aug 27 04:10:36.935956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 474/981] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:36 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:37.952313 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:37.952994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:37.959928 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:37.960385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:37.961179 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:37.961622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:38.092949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:38.100439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5e040718-a9e0-4f81-9046-df8c5c423595 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1578 microversion: 2.1 time: 0.152288 Aug 27 04:10:38.101002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 508/982] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:37 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:10:39.117645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:10:39.118249 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:10:39.124183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:39.124732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:39.125496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:10:39.125923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:10:39.253406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:10:39.262003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-28b212dc-d85c-4284-9e41-612ebb27a24c tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1565 microversion: 2.1 time: 0.148320 Aug 27 04:10:39.262579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 475/983] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:10:39 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:13.872874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:13.873480 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:13.879229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:13.879683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:13.880454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:13.880892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:13.909458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6b2194ea-caf2-4f68-8273-9fe0aa983b24 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments/6922cbc8-6710-43f4-ba92-9d76eba8376c" status: 200 len: 194 microversion: 2.20 time: 0.040838 Aug 27 04:11:13.910025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 509/984] 10.222.0.73 () {60 vars in 1454 bytes} [Fri Aug 27 04:11:13 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments/6922cbc8-6710-43f4-ba92-9d76eba8376c => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:11:13.977595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:13.978105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:13.984727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:13.985182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:13.985978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:13.986381 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:14.114769 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lazy-loading 'services' on Instance uuid eb257852-e7be-425c-b86c-f65f49093cbf {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:11:14.365957 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c5e44dfb-b87a-44ad-8a94-e8ae2fdcf86e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments/6922cbc8-6710-43f4-ba92-9d76eba8376c" status: 202 len: 0 microversion: 2.20 time: 0.391903 Aug 27 04:11:14.366532 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 476/985] 10.222.0.73 () {60 vars in 1457 bytes} [Fri Aug 27 04:11:13 2021] DELETE /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments/6922cbc8-6710-43f4-ba92-9d76eba8376c => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:11:14.376567 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:14.377470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:14.383185 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:14.383634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:14.386108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:14.386108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:14.414115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d497a922-d403-4082-870d-7e0838a32136 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041466 Aug 27 04:11:14.414694 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 510/986] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Aug 27 04:11:14 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:11:15.426455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:15.427772 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:15.433881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:15.434329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:15.435125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:15.435558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:15.464648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7243e401-de1b-4c54-95f3-20c8f69167be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042293 Aug 27 04:11:15.465187 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 477/987] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Aug 27 04:11:15 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:11:16.476031 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:16.476962 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:16.483251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:16.483719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:16.484470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:16.484905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:16.514183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5fd9a936-8762-470e-97bb-2a3831513654 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041955 Aug 27 04:11:16.514759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 511/988] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Aug 27 04:11:16 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:16.575323 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:16.575857 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:16.581603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:16.581996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:16.582794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:16.583233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:16.607079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:11:16.912380 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2cfe998c-f0c8-4442-a29b-4a6291b32e4d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 204 len: 0 microversion: 2.20 time: 0.341057 Aug 27 04:11:16.912974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 478/989] 10.222.0.73 () {60 vars in 1280 bytes} [Fri Aug 27 04:11:16 2021] DELETE /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:11:16.921460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:16.925892 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:16.928229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:16.928685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:16.929458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:16.929899 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:17.053895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:17.062896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:17.064501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:17.065643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d9651bf0-d848-438b-9e35-e336f7bf0c00 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.147920 Aug 27 04:11:17.066201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 512/990] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:16 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:18.084318 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:18.085087 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:18.091476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:18.091922 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:18.092676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:18.093105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:18.216716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:18.224402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:18.226288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:18.227282 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ac8f0478-c0c8-4119-957b-577e4b75c5cb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.146927 Aug 27 04:11:18.227796 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 479/991] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:18 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:11:19.245756 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:19.246300 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:19.252107 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:19.252551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:19.253303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:19.253730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:19.378547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:19.385189 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:19.387395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:19.388528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-af66aad0-d45e-4293-84ee-736584be9398 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1722 microversion: 2.20 time: 0.146579 Aug 27 04:11:19.389275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 513/992] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:19 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:20.406795 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:20.407402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:20.413227 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:20.413672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:20.414431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:20.414884 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:20.492821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-779904ae-ad4f-42b7-9231-cfdedd35a167 req-30b148bb-f7be-4ec2-bd7f-71593074e14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb257852-e7be-425c-b86c-f65f49093cbf", "name": "network-vif-deleted", "tag": "b31433d7-3cd6-42a4-ba1f-e7c89bc378b7"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:20.494400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:11:20.494400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:11:20.498878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:20.504918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-779904ae-ad4f-42b7-9231-cfdedd35a167 req-30b148bb-f7be-4ec2-bd7f-71593074e14f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:20.504918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-779904ae-ad4f-42b7-9231-cfdedd35a167 req-30b148bb-f7be-4ec2-bd7f-71593074e14f service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:20.507412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:20.508995 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:20.510244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c7b2a663-a98f-438c-b938-03f605c0784f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1654 microversion: 2.20 time: 0.107181 Aug 27 04:11:20.511652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 480/993] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:20 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1654 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:20.520065 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-779904ae-ad4f-42b7-9231-cfdedd35a167 req-30b148bb-f7be-4ec2-bd7f-71593074e14f service nova] Creating event network-vif-deleted:b31433d7-3cd6-42a4-ba1f-e7c89bc378b7 for instance eb257852-e7be-425c-b86c-f65f49093cbf on hv-cinder-80475 Aug 27 04:11:20.525738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-779904ae-ad4f-42b7-9231-cfdedd35a167 req-30b148bb-f7be-4ec2-bd7f-71593074e14f service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036529 Aug 27 04:11:20.526963 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 514/994] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:11:21.529178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:21.529719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:21.535396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:21.535839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:21.536594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:21.537021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:21.566947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:21.567386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:21.567830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lazy-loading 'fault' on Instance uuid eb257852-e7be-425c-b86c-f65f49093cbf {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:11:21.609510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:21.618276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:21.619569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:21.621252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-574c7c38-b1b1-4838-ade2-909eec75c5ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 200 len: 1371 microversion: 2.20 time: 0.096651 Aug 27 04:11:21.630507 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 481/995] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:21 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:22.640076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:22.640715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:22.647458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:22.647905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:22.648692 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:22.649125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:22.666113 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] HTTP exception thrown: Instance eb257852-e7be-425c-b86c-f65f49093cbf could not be found. Aug 27 04:11:22.667413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Returning 404 to user: Instance eb257852-e7be-425c-b86c-f65f49093cbf could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:11:22.668517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-98fa6727-46bd-4796-a8ce-073c596fe346 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 404 len: 111 microversion: 2.20 time: 0.033161 Aug 27 04:11:22.669090 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 515/996] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:22 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:11:22.678312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3b65b1ba-fc23-4a1d-8fe9-6fc393440bdc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '.version_select at 0x7f539339b940>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:22.780312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3b65b1ba-fc23-4a1d-8fe9-6fc393440bdc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571192423" status: 204 len: 0 microversion: 2.20 time: 0.106004 Aug 27 04:11:22.781074 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 482/997] 10.222.0.73 () {60 vars in 1262 bytes} [Fri Aug 27 04:11:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1571192423 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:11:23.687364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0ca7b7f1-d9fb-4edf-b164-323b1680c6dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'create', calling method: .version_select at 0x7f538e6c0160>, body: {"keypair": {"name": "tempest-keypair-1884324913"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:23.705250 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-0ca7b7f1-d9fb-4edf-b164-323b1680c6dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:11:23.710007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-0ca7b7f1-d9fb-4edf-b164-323b1680c6dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for user 6463ded3d09e4dbd908f0d03b20e0555 and project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:11:23.879312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-0ca7b7f1-d9fb-4edf-b164-323b1680c6dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:11:23.883066 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-0ca7b7f1-d9fb-4edf-b164-323b1680c6dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for user 6463ded3d09e4dbd908f0d03b20e0555 and project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:11:23.897589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0ca7b7f1-d9fb-4edf-b164-323b1680c6dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.215986 Aug 27 04:11:23.898262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 516/998] 10.222.0.73 () {62 vars in 1199 bytes} [Fri Aug 27 04:11:23 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 218 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Aug 27 04:11:26.492583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1444370605", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae738068-a8df-43ab-a247-dfe7ca6ceb64"}], "security_groups": [{"name": "tempest-securitygroup--1704351734"}], "key_name": "tempest-keypair-1884324913", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:26.584225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] validate_networks() for [('ae738068-a8df-43ab-a247-dfe7ca6ceb64', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:11:26.947236 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:11:26.947671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:11:26.948161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:11:26.948568 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:11:26.948981 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:11:26.957456 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:26.957901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:26.958741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:26.959175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:26.975754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:11:26.980438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Getting quotas for user 6463ded3d09e4dbd908f0d03b20e0555 and project 74bc40decbba46aba88aa9c29c8858d2. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:11:26.990984 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:11:26.993264 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:11:27.111500 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8e4e6141-8249-4950-a5fd-3e71887c4008 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.622843 Aug 27 04:11:27.114946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 483/999] 10.222.0.73 () {62 vars in 1188 bytes} [Fri Aug 27 04:11:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 27 04:11:27.122813 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aefc41df-9537-487f-b506-1243fc93fc85 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:27.123428 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-aefc41df-9537-487f-b506-1243fc93fc85 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:27.175035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-aefc41df-9537-487f-b506-1243fc93fc85 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:27.182957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-aefc41df-9537-487f-b506-1243fc93fc85 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:27.184455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-aefc41df-9537-487f-b506-1243fc93fc85 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:27.185513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aefc41df-9537-487f-b506-1243fc93fc85 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1282 microversion: 2.20 time: 0.067387 Aug 27 04:11:27.186056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 517/1000] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:27 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1282 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:28.203337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d7e45bf8-c9d4-4913-8827-74f9f76a8523 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:28.204127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d7e45bf8-c9d4-4913-8827-74f9f76a8523 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:28.258799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d7e45bf8-c9d4-4913-8827-74f9f76a8523 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:28.266307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d7e45bf8-c9d4-4913-8827-74f9f76a8523 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:28.268730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d7e45bf8-c9d4-4913-8827-74f9f76a8523 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:28.268964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d7e45bf8-c9d4-4913-8827-74f9f76a8523 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1282 microversion: 2.20 time: 0.069404 Aug 27 04:11:28.269691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 484/1001] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:28 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:29.286289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-febfa0f6-e025-4852-90a4-9eef0d956e0a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:29.286878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-febfa0f6-e025-4852-90a4-9eef0d956e0a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:29.344347 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-febfa0f6-e025-4852-90a4-9eef0d956e0a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:29.351532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-febfa0f6-e025-4852-90a4-9eef0d956e0a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:29.353125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-febfa0f6-e025-4852-90a4-9eef0d956e0a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:29.355132 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-febfa0f6-e025-4852-90a4-9eef0d956e0a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1282 microversion: 2.20 time: 0.072616 Aug 27 04:11:29.355809 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 518/1002] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:29 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1282 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:30.372417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-38957fd4-ae38-4192-89f7-b6732d7608bc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:30.373012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-38957fd4-ae38-4192-89f7-b6732d7608bc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:30.422796 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-38957fd4-ae38-4192-89f7-b6732d7608bc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:30.429877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-38957fd4-ae38-4192-89f7-b6732d7608bc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:30.431407 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-38957fd4-ae38-4192-89f7-b6732d7608bc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:30.432481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-38957fd4-ae38-4192-89f7-b6732d7608bc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1282 microversion: 2.20 time: 0.063905 Aug 27 04:11:30.433120 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 485/1003] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:30 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1282 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:31.450343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:31.451018 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:31.456982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:31.457432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:31.458213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:31.458686 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:31.519650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:31.528444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:31.529942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:31.531058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dad50238-2e28-4d0b-84a8-3e851ab3ddcb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1286 microversion: 2.20 time: 0.084859 Aug 27 04:11:31.531596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 519/1004] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:31 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:32.547850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:32.548501 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:32.554495 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:32.554966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:32.555723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:32.556150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:32.614848 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:32.623545 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:32.624563 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:32.625631 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d74b7262-8a51-4e3f-8931-fe4474a6b809 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1334 microversion: 2.20 time: 0.081446 Aug 27 04:11:32.626178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 486/1005] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:32 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1334 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:33.643957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:33.644668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:33.650514 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:33.661502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:33.661502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:33.661502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:33.712060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:33.720617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:33.722124 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:33.723242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5c79de32-0cc5-4527-88e4-7643919bb2ab tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1340 microversion: 2.20 time: 0.083017 Aug 27 04:11:33.723806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 520/1006] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:33 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1340 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:11:34.741928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:34.742537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:34.748961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:34.749509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:34.750370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:34.751095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:34.872712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:34.880713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:34.882256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:34.883389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b4f684dc-0110-497d-97fc-ec7ebdbd228a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.145268 Aug 27 04:11:34.884448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 487/1007] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:34 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:11:34.952923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-37cbbe87-bd65-43c4-86a7-2b25bbe5ad8f req-3f42275a-98c7-43db-b649-f12658914250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:34.954386 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:11:34.954386 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:11:34.961846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-37cbbe87-bd65-43c4-86a7-2b25bbe5ad8f req-3f42275a-98c7-43db-b649-f12658914250 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:34.962359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-37cbbe87-bd65-43c4-86a7-2b25bbe5ad8f req-3f42275a-98c7-43db-b649-f12658914250 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:34.975054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-37cbbe87-bd65-43c4-86a7-2b25bbe5ad8f req-3f42275a-98c7-43db-b649-f12658914250 service nova] Creating event network-changed:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:11:34.980209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-37cbbe87-bd65-43c4-86a7-2b25bbe5ad8f req-3f42275a-98c7-43db-b649-f12658914250 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033050 Aug 27 04:11:34.980810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 521/1008] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:11:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:35.901669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:35.902445 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:35.908147 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:35.908592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:35.909380 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:35.909808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:36.030835 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:36.038412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:36.039948 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:36.041029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-74dcb3b2-2df8-4216-894f-53d6acf2e2ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.143532 Aug 27 04:11:36.042285 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 488/1009] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:35 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:37.060616 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:37.061327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:37.067391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:37.067836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:37.068595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:37.069023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:37.188175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:37.195742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:37.197237 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:37.198454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f66d7200-fcbc-4567-8644-8a6f53bb31c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.142673 Aug 27 04:11:37.199019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 522/1010] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:37 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:38.216237 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:38.216843 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:38.222673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:38.223127 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:38.223895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:38.224329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:38.344482 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:38.352191 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:38.353685 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:38.354807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4b199b14-0cd7-4050-89c2-80d598205a95 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.142459 Aug 27 04:11:38.355385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 489/1011] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:38 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:39.373287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:39.373808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:39.379668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:39.380110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:39.380866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:39.381294 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:39.502343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:39.511592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:39.513079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:39.514156 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-267416d3-158f-4ae3-b205-f25ce1a0699d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.145422 Aug 27 04:11:39.514728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 523/1012] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:39 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:40.532030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:40.532607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:40.538490 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:40.538961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:40.539726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:40.540158 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:40.658487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:40.667291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:40.668911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:40.670039 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-407550d9-e6d7-4ca6-872d-32193a37232e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.141788 Aug 27 04:11:40.670610 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 490/1013] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:40 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:41.688677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:41.689216 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:41.695046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:41.695500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:41.696275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:41.696713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:41.819245 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:41.827266 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:41.828819 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:41.829900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bc4543d2-8b87-4774-85d8-69c9277a1a39 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.145139 Aug 27 04:11:41.830462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 524/1014] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:41 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:42.416843 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-a53cba4c-da43-4153-a855-7db291727b89 req-4082b792-be9c-4174-aa86-e473d1c7302d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "name": "network-vif-plugged", "status": "completed", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:42.419070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:11:42.419070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:11:42.426031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-a53cba4c-da43-4153-a855-7db291727b89 req-4082b792-be9c-4174-aa86-e473d1c7302d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:42.426471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-a53cba4c-da43-4153-a855-7db291727b89 req-4082b792-be9c-4174-aa86-e473d1c7302d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:42.438011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-a53cba4c-da43-4153-a855-7db291727b89 req-4082b792-be9c-4174-aa86-e473d1c7302d service nova] Creating event network-vif-plugged:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:11:42.443103 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-a53cba4c-da43-4153-a855-7db291727b89 req-4082b792-be9c-4174-aa86-e473d1c7302d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029863 Aug 27 04:11:42.443685 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 491/1015] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:11:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:42.848960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:42.849561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:42.856002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:42.859680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:42.859680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:42.859680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:42.983757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:42.991422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:42.992936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:42.994015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-40a4c950-ddb7-4626-b776-63aa263c304e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.148786 Aug 27 04:11:42.994607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 525/1016] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:42 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:44.012414 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:44.013094 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:44.019158 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:44.019607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:44.020367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:44.020798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:44.142463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:44.150319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:44.151886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:44.153573 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-34b49b0c-f390-48bf-9a57-7f9701e4fb25 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1408 microversion: 2.20 time: 0.145300 Aug 27 04:11:44.154125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 492/1017] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:44 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1408 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:45.171056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:45.171658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:45.177961 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:45.178414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:45.179218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:45.179657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:45.295529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:45.303564 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:45.305068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:11:45.306200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e113ecb2-8a9b-4e9f-89ae-7d021b6a3d94 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1600 microversion: 2.20 time: 0.138889 Aug 27 04:11:45.306786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 526/1018] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:11:45 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1600 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:45.323294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:45.324353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:45.330005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:45.330455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:45.331252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:45.331684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:45.407903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c9043ee9-cc7c-4c0f-b308-36f115d41608 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.088156 Aug 27 04:11:45.408510 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 493/1019] 10.222.0.73 () {60 vars in 1316 bytes} [Fri Aug 27 04:11:45 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:11:46.760518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:46.761513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:46.767961 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:46.768411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:46.769197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:46.769620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:46.878062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-01d424ff-de97-43d7-b6d6-5fcb038774db tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.121076 Aug 27 04:11:46.878982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 527/1020] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:46 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:46.884164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-b78147b1-ce53-41d9-8e83-f50c49cb7fa9 req-c58fcba2-075f-47b2-b6e8-e28fc9feeffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:46.896760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:11:46.896760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:11:46.896760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-b78147b1-ce53-41d9-8e83-f50c49cb7fa9 req-c58fcba2-075f-47b2-b6e8-e28fc9feeffd service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:46.896760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-b78147b1-ce53-41d9-8e83-f50c49cb7fa9 req-c58fcba2-075f-47b2-b6e8-e28fc9feeffd service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:46.905927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-b78147b1-ce53-41d9-8e83-f50c49cb7fa9 req-c58fcba2-075f-47b2-b6e8-e28fc9feeffd service nova] Creating event network-changed:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:11:46.911287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-b78147b1-ce53-41d9-8e83-f50c49cb7fa9 req-c58fcba2-075f-47b2-b6e8-e28fc9feeffd service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151931 Aug 27 04:11:46.911891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 494/1021] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:47.890397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:47.891322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:47.897918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:47.899421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:47.899421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:47.900226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:47.987408 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4e9e4cf8-773f-469f-857c-f02f3ca4a6ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.101584 Aug 27 04:11:47.988204 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 528/1022] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:47 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:49.000823 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:49.001791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:49.007973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:49.008702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:49.009173 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:49.009605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:49.096612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7c5605e8-942e-4fd5-9a7a-946e0e0875ee tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.101982 Aug 27 04:11:49.097397 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 495/1023] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:48 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:50.108448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:50.109447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:50.115893 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:50.116352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:50.117125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:50.117566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:50.204539 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6792a734-2d71-4846-aa4e-436c31f3a1f2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.100516 Aug 27 04:11:50.205160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 529/1024] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:50 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:51.216528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:51.217541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:51.223919 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:51.224365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:51.225129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:51.225555 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:51.313666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b7c354c7-e97f-4a99-8046-331ba11e149b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.101646 Aug 27 04:11:51.314184 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 496/1025] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:51 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:52.324648 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:52.325563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:52.332040 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:52.332495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:52.333272 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:52.333713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:52.414138 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2b3a24c1-6a7d-4559-90e8-0e41dc9bcc72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.093951 Aug 27 04:11:52.414810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 530/1026] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:52 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:53.426035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:53.427089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:53.434667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:53.435274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:53.436051 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:53.436492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:53.520830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b2e12825-d915-4335-bb6a-5bde21566a43 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.098720 Aug 27 04:11:53.521435 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 497/1027] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:53 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:54.532341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:54.533328 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:54.539767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:54.540213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:54.540990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:54.541429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:54.628657 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3e8aab05-2abe-491a-b60c-10747dee1eb9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.100296 Aug 27 04:11:54.629310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 531/1028] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:54 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:11:55.641087 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:55.642091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:55.648962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:55.649416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:55.650322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:55.650712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:55.734137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f6986c15-8df4-415e-98bc-2dce5d65ffc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.097875 Aug 27 04:11:55.734965 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 498/1029] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:55 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:56.162820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-473291427"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:56.163469 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:56.170019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:56.170459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:56.171250 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:56.171686 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:56.288596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.network.security_group_api [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Removing security group 41ddedba-03b1-4a7d-863e-2bf9c24f31f2 from port 14a51c81-8273-4b66-bcee-30da752b0e22 Aug 27 04:11:56.678444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9da39460-7bcf-4da5-81f4-0cec267a543b tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/action" status: 202 len: 0 microversion: 2.1 time: 0.519591 Aug 27 04:11:56.680156 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 532/1030] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:11:56 2021] POST /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:11:56.689288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-69e2fd64-e4ff-4d05-98ba-cf5e2df84b3a req-4bcec670-12ac-487e-850c-ef115161cf64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:56.690772 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:11:56.690772 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:11:56.705432 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-69e2fd64-e4ff-4d05-98ba-cf5e2df84b3a req-4bcec670-12ac-487e-850c-ef115161cf64 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:56.706285 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-69e2fd64-e4ff-4d05-98ba-cf5e2df84b3a req-4bcec670-12ac-487e-850c-ef115161cf64 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:56.723773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-69e2fd64-e4ff-4d05-98ba-cf5e2df84b3a req-4bcec670-12ac-487e-850c-ef115161cf64 service nova] Creating event network-changed:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:11:56.734573 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-69e2fd64-e4ff-4d05-98ba-cf5e2df84b3a req-4bcec670-12ac-487e-850c-ef115161cf64 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049451 Aug 27 04:11:56.735337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 499/1031] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:56.744990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:56.746046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:56.752228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:56.752762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:56.753788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:56.754419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:56.847713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-59f80d3c-7091-474c-a1d8-5980f0545378 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 14 microversion: 2.20 time: 0.104799 Aug 27 04:11:56.848725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 533/1032] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:56 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:11:57.860015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:57.861083 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:57.867636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:57.868097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:57.868912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:57.869350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:57.966868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-038fbf65-1a08-49e8-82a2-5299b9d68353 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 9491 microversion: 2.20 time: 0.110960 Aug 27 04:11:57.967477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 500/1033] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:57 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 9491 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:11:58.237049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:58.237655 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:58.244055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.244511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:58.245291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.246139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:58.331223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lazy-loading 'services' on Instance uuid fbca5e4f-6df6-40d4-bd08-9ad3085ff92f {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:11:58.534871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cceb6e45-a8cc-4a2d-98f2-b67fb8d74676 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments/6b3f91ba-6ec8-42be-b208-3fb4d43706cc" status: 202 len: 0 microversion: 2.1 time: 0.301268 Aug 27 04:11:58.535458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 534/1034] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:11:58 2021] DELETE /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments/6b3f91ba-6ec8-42be-b208-3fb4d43706cc => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:11:58.544054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:58.545406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:58.551941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.552737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:58.553592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.554036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:58.583586 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4067c2db-c9e3-4acc-8ff1-6abb3588ce16 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Aug 27 04:11:58.584153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 501/1035] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:11:58 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:11:58.751026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-8ed58696-4d7c-442b-a326-e75982f4145f req-248520d8-8fbc-4733-b316-20d113e15c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:58.752636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:11:58.752636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:11:58.759685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-8ed58696-4d7c-442b-a326-e75982f4145f req-248520d8-8fbc-4733-b316-20d113e15c0e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.763983 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-8ed58696-4d7c-442b-a326-e75982f4145f req-248520d8-8fbc-4733-b316-20d113e15c0e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:58.771421 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-8ed58696-4d7c-442b-a326-e75982f4145f req-248520d8-8fbc-4733-b316-20d113e15c0e service nova] Creating event network-changed:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:11:58.776346 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-8ed58696-4d7c-442b-a326-e75982f4145f req-248520d8-8fbc-4733-b316-20d113e15c0e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030363 Aug 27 04:11:58.776942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 535/1036] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:11:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:11:58.978982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:11:58.980039 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:58.986611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.987310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:58.988234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:58.988672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:59.097326 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0718bcfe-8429-4ce9-98e0-c8cba0f99d81 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 16877 microversion: 2.20 time: 0.122538 Aug 27 04:11:59.097955 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 502/1037] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:11:58 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 16877 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:11:59.598173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:11:59.599164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:11:59.605285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:59.605729 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:59.606580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:11:59.607025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:11:59.634919 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5f789217-b364-4e02-aa6b-01ef8c2c296c tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041175 Aug 27 04:11:59.635452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 536/1038] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:11:59 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:00.109677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:00.110617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:00.117168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:00.123580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:00.123580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:00.123580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:00.210294 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cb4aa568-41f8-4767-a9ab-d67dc2af7611 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 18356 microversion: 2.20 time: 0.105109 Aug 27 04:12:00.210959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 503/1039] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:00 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 18356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:00.646403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:00.647325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:00.653636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:00.654079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:00.654869 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:00.655296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:00.683387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a5dcebd8-cfbc-436e-bf95-e8b65a33d8b3 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040774 Aug 27 04:12:00.683928 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 537/1040] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:12:00 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:12:00.693819 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:00.694434 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:00.701263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:00.701709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:00.702475 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:00.702941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:00.780486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] HTTP exception thrown: Instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f is not attached to volume 6b3f91ba-6ec8-42be-b208-3fb4d43706cc Aug 27 04:12:00.781080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Returning 404 to user: Instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f is not attached to volume 6b3f91ba-6ec8-42be-b208-3fb4d43706cc {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:12:00.781910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e5de53bd-eb49-470a-8c4a-ddc4e719a563 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments/6b3f91ba-6ec8-42be-b208-3fb4d43706cc" status: 404 len: 154 microversion: 2.1 time: 0.092208 Aug 27 04:12:00.782458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 504/1041] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:12:00 2021] DELETE /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f/os-volume_attachments/6b3f91ba-6ec8-42be-b208-3fb4d43706cc => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:12:01.221841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:01.222777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:01.228626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:01.229027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:01.229792 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:01.230234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:01.320884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-21f217de-e066-446d-9a68-a6e4bfcd54b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 20997 microversion: 2.20 time: 0.102544 Aug 27 04:12:01.321504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 538/1042] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:01 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 20997 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:02.231379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:02.232443 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:02.238732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:02.239187 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:02.239963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:02.240402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:02.265972 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:12:02.333224 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:02.334131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:02.340557 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:02.344805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:02.344805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:02.344805 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:02.434036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-eee15878-7f50-4528-82cd-e86cf98e4cc7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 22988 microversion: 2.20 time: 0.104731 Aug 27 04:12:02.435803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 539/1043] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:02 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 22988 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:02.561128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0b7aaf12-f4d7-4eaf-8d31-538345d9bf64 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 204 len: 0 microversion: 2.1 time: 0.333134 Aug 27 04:12:02.561727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 505/1044] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:12:02 2021] DELETE /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:12:02.570318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:02.571176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:02.577914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:02.578367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:02.579175 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:02.579619 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:02.700160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:02.707600 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b1ca638c-0ca9-43c5-bb33-7b93bd3a31cc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1555 microversion: 2.1 time: 0.141310 Aug 27 04:12:02.708155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 540/1045] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:02 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1555 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:03.446030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:03.447038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:03.452939 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:03.453386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:03.454186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:03.454645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:03.551191 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-489250bc-15d1-4a8a-9673-a29a89f92183 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 23804 microversion: 2.20 time: 0.109102 Aug 27 04:12:03.551804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 506/1046] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:03 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 23804 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:03.724366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:03.724985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:03.731260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:03.731864 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:03.732613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:03.733039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:03.850513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:03.858744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0ddace78-d61e-4430-9d79-486fe0810885 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1555 microversion: 2.1 time: 0.137978 Aug 27 04:12:03.859321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 541/1047] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:03 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:04.563594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:04.564580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:04.570711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:04.571164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:04.571924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:04.572355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:04.725132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ecd4c981-f0ea-4575-a6d5-6b446e6a9f45 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 25197 microversion: 2.20 time: 0.165653 Aug 27 04:12:04.725767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 507/1048] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:04 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 25197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:04.876006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:04.876623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:04.882687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:04.889019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:04.889019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:04.889019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:05.016321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:05.024092 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3dc2586b-e0fb-4268-9a60-bd0026161b07 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1555 microversion: 2.1 time: 0.152105 Aug 27 04:12:05.024660 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 542/1049] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:04 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:05.506786 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-f27b041d-9326-429e-8086-e68def1cac5f req-a63bc980-6132-42ea-be4c-4da8dc1e303e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbca5e4f-6df6-40d4-bd08-9ad3085ff92f", "name": "network-vif-deleted", "tag": "14a51c81-8273-4b66-bcee-30da752b0e22"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:05.508233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:12:05.508233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:12:05.516195 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-f27b041d-9326-429e-8086-e68def1cac5f req-a63bc980-6132-42ea-be4c-4da8dc1e303e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:05.516648 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-f27b041d-9326-429e-8086-e68def1cac5f req-a63bc980-6132-42ea-be4c-4da8dc1e303e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:05.527110 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-f27b041d-9326-429e-8086-e68def1cac5f req-a63bc980-6132-42ea-be4c-4da8dc1e303e service nova] Creating event network-vif-deleted:14a51c81-8273-4b66-bcee-30da752b0e22 for instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f on hv-cinder-80475 Aug 27 04:12:05.532490 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-f27b041d-9326-429e-8086-e68def1cac5f req-a63bc980-6132-42ea-be4c-4da8dc1e303e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029780 Aug 27 04:12:05.533066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 508/1050] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:05.737542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:05.738413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:05.744944 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:05.745398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:05.746313 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:05.746790 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:05.840165 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2b022591-a476-4314-b13e-c35265947c6f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 26800 microversion: 2.20 time: 0.107108 Aug 27 04:12:05.841477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 543/1051] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:05 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 26800 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:06.041391 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:06.042092 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:06.048701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:06.049253 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:06.050108 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:06.050693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:06.084145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:06.084595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:06.085052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lazy-loading 'fault' on Instance uuid fbca5e4f-6df6-40d4-bd08-9ad3085ff92f {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:12:06.124864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ee2fe0b619014522a8bd2bcaf7378660', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d44e8045c24df28323402022ac9228', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:06.133175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-84cae84a-d0b6-4f4a-a1e1-f733f08aa8fc tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 200 len: 1349 microversion: 2.1 time: 0.095902 Aug 27 04:12:06.133839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 509/1052] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:06 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 1349 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:06.853388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:06.854316 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:06.862613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:06.863056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:06.863838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:06.864269 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:06.962759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-966b9127-168e-48f1-ba4d-8e44070f6ffa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 27644 microversion: 2.20 time: 0.113275 Aug 27 04:12:06.963414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 544/1053] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:06 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 27644 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:07.151118 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:07.151665 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] [instance: fbca5e4f-6df6-40d4-bd08-9ad3085ff92f] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:07.158452 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:07.158928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:07.159700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:07.160136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:07.174128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] HTTP exception thrown: Instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f could not be found. Aug 27 04:12:07.174758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Returning 404 to user: Instance fbca5e4f-6df6-40d4-bd08-9ad3085ff92f could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:12:07.175579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c85bc145-3eb1-4e09-a129-9d9d7a6018a1 tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f" status: 404 len: 111 microversion: 2.1 time: 0.028225 Aug 27 04:12:07.176113 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 510/1054] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:07 2021] GET /compute/v2.1/servers/fbca5e4f-6df6-40d4-bd08-9ad3085ff92f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:12:07.185044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e2bc512d-e1cc-48ea-8369-68d57b3ad0ef tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] Calling method '.version_select at 0x7f538e6d2550>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:07.264754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e2bc512d-e1cc-48ea-8369-68d57b3ad0ef tempest-TestMinimumBasicScenario-584940468 tempest-TestMinimumBasicScenario-584940468-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1358440251" status: 202 len: 0 microversion: 2.1 time: 0.083648 Aug 27 04:12:07.265864 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 545/1055] 10.222.0.73 () {58 vars in 1272 bytes} [Fri Aug 27 04:12:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1358440251 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:07.973971 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:07.974933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:07.980931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:07.981385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:07.982161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:07.982624 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:08.078864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2e8bd4ec-aa7a-471f-8e1f-9c58c3741f2d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28006 microversion: 2.20 time: 0.108227 Aug 27 04:12:08.079511 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 511/1056] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:07 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28006 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:09.091239 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:09.092252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:09.099782 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:09.100236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:09.101252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:09.102005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:09.192382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2706010f-6076-49ad-9b2a-9dfb49a8c184 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.105413 Aug 27 04:12:09.193028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 546/1057] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:09 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:10.205148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:10.206160 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:10.213315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:10.213999 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:10.214826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:10.215431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:10.317124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-737d1104-f3de-4c30-aca7-b29cff08d789 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.117257 Aug 27 04:12:10.317822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 512/1058] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:10 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:11.329426 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:11.331106 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:11.337887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:11.338288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:11.339104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:11.339547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:11.425848 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c2e7de40-f33a-48a0-bbf8-977ccf9fe739 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.100328 Aug 27 04:12:11.426482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 547/1059] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:11 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:12.439085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:12.440113 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:12.446402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:12.449476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:12.450343 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:12.451187 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:12.544340 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ab9d70dd-8c46-4058-a6b9-e1e15c4e64cd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.110025 Aug 27 04:12:12.546589 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 513/1060] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:12 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:13.556856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:13.558032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:13.565315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:13.565767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:13.566540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:13.566999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:13.646910 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f999710f-90b8-4658-84fe-54966b86f74c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.094113 Aug 27 04:12:13.647621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 548/1061] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:13 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:14.659804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:14.660918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:14.667912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:14.668382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:14.669222 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:14.669714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:14.760379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-de3d9817-82d7-4b6a-89e3-962a40143c6b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.104634 Aug 27 04:12:14.761286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 514/1062] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:14 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:15.778220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:15.779263 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:15.786310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:15.786834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:15.787569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:15.788025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:15.872644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a203e0ea-8b4b-45c2-a86f-dfa18b019550 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.098405 Aug 27 04:12:15.873560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 549/1063] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:15 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:16.886118 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:16.887124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:16.894490 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:16.894961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:16.897585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:16.897585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:16.984041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0cb57b17-4c72-40b6-8704-6a38e7d1112a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.101778 Aug 27 04:12:16.985569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 515/1064] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:16 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:17.997227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:17.998226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:18.004989 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:18.005436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:18.006214 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:18.006677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:18.096214 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-00e216d0-a8c9-4a47-a8a5-f43c784aae35 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.102877 Aug 27 04:12:18.096882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 550/1065] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:17 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:19.108652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:19.109710 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:19.118807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:19.119260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:19.120041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:19.120475 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:19.201069 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-87d00b7a-530a-4c33-b482-57a773ed288c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.096367 Aug 27 04:12:19.201711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 516/1066] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:19 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:20.214502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:20.215519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:20.222507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:20.222976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:20.223766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:20.224196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:20.306299 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-404c3842-21e3-4937-8fd9-1ba63b6fbb6a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.095612 Aug 27 04:12:20.307010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 551/1067] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:20 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:21.318361 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:21.319302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:21.325765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:21.326217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:21.327021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:21.327461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:21.412331 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2c529c3b-6a85-45c9-8851-b9f6acde2ef0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28190 microversion: 2.20 time: 0.097989 Aug 27 04:12:21.412963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 517/1068] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:21 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:22.426010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:22.427029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:22.433962 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:22.434417 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:22.435230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:22.435666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:22.524380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-23b4a66b-e588-48c3-ba38-3fea22e1c1e6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28481 microversion: 2.20 time: 0.103484 Aug 27 04:12:22.525002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 552/1069] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:22 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28481 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:23.536722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:23.537706 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:23.544176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:23.544617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:23.545395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:23.545823 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:23.637004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fdf1c89b-c503-4350-adc0-31ec76bbf396 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28481 microversion: 2.20 time: 0.104228 Aug 27 04:12:23.637734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 518/1070] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:23 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28481 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:24.649468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:24.650450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:24.656844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:24.657289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:24.658079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:24.658510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:24.751992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7554c4bb-2f28-4c96-883b-bbffeef74d36 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.106562 Aug 27 04:12:24.752626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 553/1071] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:24 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:25.765129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:25.766114 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:25.773403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:25.773853 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:25.774712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:25.775157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:25.859296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-76a50d82-8195-4661-859e-49b5a17f2c12 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.097983 Aug 27 04:12:25.859951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 519/1072] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:25 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:26.871373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:26.872378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:26.880041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:26.880506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:26.881285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:26.881721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:26.967375 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9be32c29-9194-4aaa-8058-5377a7bd3506 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.099859 Aug 27 04:12:26.968024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 554/1073] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:26 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:27.979248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:27.980245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:27.986732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:27.987199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:27.987990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:27.988421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:28.075230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-19167ef2-6a9d-481e-8ef0-9a6afed5d3ea tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.099829 Aug 27 04:12:28.075891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 520/1074] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:27 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:29.087231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:29.088206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:29.094948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:29.095399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:29.096183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:29.096619 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:29.183357 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aa02a3ab-176e-4ff0-a337-460fa553740c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.100265 Aug 27 04:12:29.184010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 555/1075] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:29 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:30.196879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:30.197888 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:30.204714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:30.205018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:30.205813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:30.206252 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:30.291955 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5519935e-ee7d-46df-930f-4d390d93d1bd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.100310 Aug 27 04:12:30.292519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 521/1076] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:30 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:31.306350 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:31.307938 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:31.316881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:31.318668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:31.318864 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:31.319200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:31.406856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5ed4f4db-bb57-4812-a4e2-1a6a6700c71d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.106241 Aug 27 04:12:31.407766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 556/1077] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:31 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:31.732760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:31.733344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:31.735909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-2032f346-ce90-4246-b4a6-7191e8102de1 req-4cc82d1f-4cd8-468b-8053-8da06ac2370c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:31.737379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:12:31.737379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:12:31.741104 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:31.741708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:31.742515 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:31.742978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:31.745978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-2032f346-ce90-4246-b4a6-7191e8102de1 req-4cc82d1f-4cd8-468b-8053-8da06ac2370c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:31.746664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-2032f346-ce90-4246-b4a6-7191e8102de1 req-4cc82d1f-4cd8-468b-8053-8da06ac2370c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:31.758181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-2032f346-ce90-4246-b4a6-7191e8102de1 req-4cc82d1f-4cd8-468b-8053-8da06ac2370c service nova] Creating event network-changed:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:12:31.763414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-2032f346-ce90-4246-b4a6-7191e8102de1 req-4cc82d1f-4cd8-468b-8053-8da06ac2370c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031337 Aug 27 04:12:31.764634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 557/1078] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:12:31.771194 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:12:32.122212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-216d1c3d-5356-4835-80d5-cbdb6827c9e0 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "DELETE /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 204 len: 0 microversion: 2.1 time: 0.393159 Aug 27 04:12:32.123541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 522/1079] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:12:31 2021] DELETE /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 27 04:12:32.132694 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:32.133959 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:32.139611 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:32.140064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:32.140895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:32.141319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:32.285630 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:32.294062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-55979980-af01-4606-b73b-896e0f9d055f tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1571 microversion: 2.1 time: 0.165526 Aug 27 04:12:32.294992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 558/1080] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:32 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:32.420913 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:32.425868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:32.430433 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:32.430925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:32.431733 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:32.432175 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:32.532503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f6b90361-2571-4e30-abb1-8365467ae8f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.116953 Aug 27 04:12:32.533151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 523/1081] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:32 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:33.312865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:33.313432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:33.320626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:33.321087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:33.321901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:33.322344 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:33.456843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:33.465473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5e933617-13f7-45ce-a31a-e0d3622a939a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1452 microversion: 2.1 time: 0.156675 Aug 27 04:12:33.466062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 559/1082] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:33 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:33.544458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:33.545444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:33.552018 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:33.552468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:33.553509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:33.553945 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:33.773462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6b7e8f85-520b-43e2-8c42-7663976871fb tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.233021 Aug 27 04:12:33.774142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 524/1083] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:33 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:34.484186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:34.485028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:34.491631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:34.492075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:34.492845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:34.493274 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:34.606195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:34.606195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cdf10107-d3b4-4473-89ba-7fe2df05b742 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1384 microversion: 2.1 time: 0.083522 Aug 27 04:12:34.606195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 560/1084] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:34 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1384 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:34.606988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-2f07f381-e536-46ff-92c8-0b296c656770 req-fb5a26b6-aa92-4f54-b819-3acb484d585c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "882054ae-274e-4eeb-96d8-2b543f110b88", "name": "network-vif-deleted", "tag": "be08ab01-9722-4c1f-b10f-e51c4d71b849"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:34.606988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:12:34.606988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:12:34.606988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-2f07f381-e536-46ff-92c8-0b296c656770 req-fb5a26b6-aa92-4f54-b819-3acb484d585c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:34.606988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-2f07f381-e536-46ff-92c8-0b296c656770 req-fb5a26b6-aa92-4f54-b819-3acb484d585c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:34.608461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-2f07f381-e536-46ff-92c8-0b296c656770 req-fb5a26b6-aa92-4f54-b819-3acb484d585c service nova] Creating event network-vif-deleted:be08ab01-9722-4c1f-b10f-e51c4d71b849 for instance 882054ae-274e-4eeb-96d8-2b543f110b88 on hv-cinder-80475 Aug 27 04:12:34.608461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-2f07f381-e536-46ff-92c8-0b296c656770 req-fb5a26b6-aa92-4f54-b819-3acb484d585c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 Aug 27 04:12:34.608461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 525/1085] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:12:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:12:34.785251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:34.786737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:34.792538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:34.793026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:34.793756 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:34.794193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:34.882059 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bfdee050-7923-4ab7-bba7-98c620e7dde2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.100304 Aug 27 04:12:34.882801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 561/1086] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:34 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:35.581303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:35.582022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:35.589892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:35.590276 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:35.591099 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:35.591546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:35.623658 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:35.624334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:35.624558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lazy-loading 'fault' on Instance uuid 882054ae-274e-4eeb-96d8-2b543f110b88 {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:12:35.665512 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c8e2b8a0f3f49f4a3e20160ec0b0193', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43ccefac7f3746c68214be66026da43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:12:35.673007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-234fddfc-2a1b-4757-82d8-c78cc8422f0a tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 200 len: 1225 microversion: 2.1 time: 0.095726 Aug 27 04:12:35.673576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 526/1087] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:35 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 1225 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:12:35.894120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:35.895058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:35.902157 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:35.902648 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:35.903481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:35.903924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:35.997986 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-469c3ae8-24c5-45cd-9bcd-bb27309e40a6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.107875 Aug 27 04:12:35.998674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 562/1088] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:35 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:36.697125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:36.697766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] [instance: 882054ae-274e-4eeb-96d8-2b543f110b88] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:36.704272 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:36.704714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:36.705471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:36.705933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:36.718856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] HTTP exception thrown: Instance 882054ae-274e-4eeb-96d8-2b543f110b88 could not be found. Aug 27 04:12:36.719456 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Returning 404 to user: Instance 882054ae-274e-4eeb-96d8-2b543f110b88 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:12:36.720268 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a9bfbbf9-5816-41d6-91e1-0566c810efad tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88" status: 404 len: 111 microversion: 2.1 time: 0.027208 Aug 27 04:12:36.720763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 527/1089] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:12:36 2021] GET /compute/v2.1/servers/882054ae-274e-4eeb-96d8-2b543f110b88 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:12:36.996803 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-64844b8e-3d36-4b73-a07a-173a917bfed7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] Calling method '.version_select at 0x7f538e615430>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:12:37.011274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:37.012420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:37.018605 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:37.020035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:37.020035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:37.021364 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:37.072190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-64844b8e-3d36-4b73-a07a-173a917bfed7 tempest-TestShelveInstance-782509468 tempest-TestShelveInstance-782509468-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018250317" status: 202 len: 0 microversion: 2.1 time: 0.079378 Aug 27 04:12:37.072764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 563/1090] 10.222.0.73 () {58 vars in 1254 bytes} [Fri Aug 27 04:12:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2018250317 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:37.108632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dcd31343-f17d-4ce1-bd70-7c83c6094725 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.100869 Aug 27 04:12:37.109484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 528/1091] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:37 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:38.121502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:38.122442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:38.129461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:38.130885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:38.131442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:38.131877 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:38.213771 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-52518bb6-15fe-4cc2-b5ef-0d537289b3b0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.096451 Aug 27 04:12:38.215283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 564/1092] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:38 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:39.228962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:39.230729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:39.237109 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:39.237573 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:39.238363 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:39.240248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:39.324574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3751db47-fce6-4033-8855-c96faa388de3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.101111 Aug 27 04:12:39.325213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 529/1093] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:39 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:40.337617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:40.338636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:40.345088 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:40.345543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:40.346301 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:40.346763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:40.432252 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c07c87e7-e738-4f41-a0c3-f23d6d0ae07d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.099216 Aug 27 04:12:40.436336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 565/1094] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:40 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:41.444536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:41.445537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:41.451932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:41.452390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:41.453171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:41.453615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:41.547701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-56827410-36bc-459a-854a-83a857a0583c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.107520 Aug 27 04:12:41.551519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 530/1095] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:41 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:42.561003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:42.565095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:42.573599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:42.573993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:42.574851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:42.575306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:42.676773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-31bb8f0b-1b5a-49a1-8433-7ef6ed07e37f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.120765 Aug 27 04:12:42.678389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 566/1096] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:42 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:43.690754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:43.692725 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:43.700100 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:43.700662 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:43.706036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:43.706485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:43.796692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-132be9db-6710-4134-9144-fe15d4583c0f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.109867 Aug 27 04:12:43.797341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 531/1097] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:43 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:44.810708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:44.811617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:44.818533 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:44.819009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:44.819784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:44.820256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:44.903801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e816e9e0-19dd-47d1-bf54-a4296377ca5b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.097059 Aug 27 04:12:44.908681 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 567/1098] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:44 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:45.917217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:45.918153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:45.925535 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:45.926021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:45.927359 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:45.928048 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:46.020135 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3f5b7d13-8e89-4f6f-a738-ee040e42c4c9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.107012 Aug 27 04:12:46.020782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 532/1099] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:45 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:46.153271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:12:46.154001 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:12:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:12:47.032572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:47.033631 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:47.040449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:47.040931 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:47.041716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:47.042159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:47.131860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-16640326-fc6a-4eea-a5cc-2d22947f0fb2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.103334 Aug 27 04:12:47.132783 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 568/1100] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:47 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:48.144519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:48.145661 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:48.152406 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:48.152855 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:48.153666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:48.154101 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:48.242383 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c1f8ed3b-5669-4fe3-8ed0-115c702db539 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.101873 Aug 27 04:12:48.243150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 533/1101] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:48 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:49.254719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:49.255707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:49.262158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:49.262731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:49.263506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:49.263936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:49.344901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-16782711-096c-4da9-b955-09e52b45efd9 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.094726 Aug 27 04:12:49.345730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 569/1102] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:49 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:50.357964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:50.359022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:50.365891 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:50.366341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:50.367156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:50.367644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:50.453311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-89655235-6830-46b2-98a6-c860b0168f2b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.097903 Aug 27 04:12:50.453311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 534/1103] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:50 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:51.467018 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:51.468256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:51.475422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:51.475875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:51.476662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:51.477098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:51.566915 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e1b1ea6f-716f-421e-81c7-734c5f615514 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.102756 Aug 27 04:12:51.567603 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 570/1104] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:51 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:52.579749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:52.580739 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:52.587591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:52.588121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:52.588904 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:52.589341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:52.682174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-84ffd283-6db9-44df-82c5-f9d749ac33c2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.106153 Aug 27 04:12:52.683382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 535/1105] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:52 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:53.696041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:53.697144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:53.703763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:53.704212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:53.705021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:53.705725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:53.791388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-09ef6e62-7eb7-48b7-a2c7-246131f94250 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 28649 microversion: 2.20 time: 0.100129 Aug 27 04:12:53.792473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 571/1106] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:53 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 28649 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:54.804272 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:54.805703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:54.812062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:54.812509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:54.813319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:54.813753 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:54.909295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5f7bb2e0-133f-42dd-b6ac-bc1c6ad967d2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 29016 microversion: 2.20 time: 0.109795 Aug 27 04:12:54.910498 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 536/1107] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:54 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 29016 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:12:55.931097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:55.933440 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:55.954267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:55.955361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:55.959956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:55.961698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:56.095677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8681c732-0587-46c1-8d5b-40120bba5a19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 31459 microversion: 2.20 time: 0.175828 Aug 27 04:12:56.096344 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 572/1108] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:55 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 31459 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:57.111654 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:57.112666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:57.127292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:57.128165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:57.129688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:57.130587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:57.245703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-638fe888-5d3c-4938-8f14-c02af6af630b tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 33244 microversion: 2.20 time: 0.138101 Aug 27 04:12:57.247450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 537/1109] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:57 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 33244 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:58.258641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:58.261012 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:58.270321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:58.271143 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:58.272786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:58.273705 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:58.373558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6d890e1f-694c-4b7c-8cb6-37d4f23545c8 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 34266 microversion: 2.20 time: 0.119296 Aug 27 04:12:58.374908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 573/1110] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:58 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 34266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:12:59.386814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:12:59.388506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:12:59.404448 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:59.415578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:59.415578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:12:59.415578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:12:59.501707 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7b3230cb-94ab-4e69-9044-2781c6b64afd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 35513 microversion: 2.20 time: 0.119047 Aug 27 04:12:59.502369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 538/1111] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:12:59 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 35513 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:00.100050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f862976f-9832-4b5f-b995-a9a5f87f9b4e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Action: 'create', calling method: .version_select at 0x7f538e615940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1777048250"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:00.118310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-f862976f-9832-4b5f-b995-a9a5f87f9b4e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for project 98836f9ced7149bc904274a5add221ec. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:13:00.122121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-f862976f-9832-4b5f-b995-a9a5f87f9b4e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for user 37ca683634884d9f8af26dba5bbea16f and project 98836f9ced7149bc904274a5add221ec. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:13:00.376815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-f862976f-9832-4b5f-b995-a9a5f87f9b4e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for project 98836f9ced7149bc904274a5add221ec. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:13:00.381475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-f862976f-9832-4b5f-b995-a9a5f87f9b4e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for user 37ca683634884d9f8af26dba5bbea16f and project 98836f9ced7149bc904274a5add221ec. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:13:00.394490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f862976f-9832-4b5f-b995-a9a5f87f9b4e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.492169 Aug 27 04:13:00.395328 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 574/1112] 10.222.0.73 () {60 vars in 1158 bytes} [Fri Aug 27 04:12:59 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:00.515178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:00.516308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:00.523630 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:00.524089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:00.527780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:00.527780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:00.620959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e9c29662-6a50-4600-94d4-2f4320033479 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 37053 microversion: 2.20 time: 0.109433 Aug 27 04:13:00.622644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 539/1113] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:00 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 37053 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:13:01.633734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:01.634765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:01.642501 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:01.647769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:01.648706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:01.649145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:01.748068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-869aa4b1-ed28-4adf-a3d9-1d5f9d7b8685 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 38207 microversion: 2.20 time: 0.118471 Aug 27 04:13:01.748981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 575/1114] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:01 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 38207 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:02.760867 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:02.763153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:02.788318 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:02.788784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:02.789582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:02.790030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:02.890053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f2750d90-939e-4b2a-9fcd-f67e1fc55c72 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 38207 microversion: 2.20 time: 0.133346 Aug 27 04:13:02.891354 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 540/1115] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:02 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 38207 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:03.903243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:03.904230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:03.911388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:03.911833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:03.912604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:03.913035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:03.994617 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ee137727-a1bb-4728-a09b-d9fb41cf26e2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 38207 microversion: 2.20 time: 0.095329 Aug 27 04:13:03.998659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 576/1116] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:03 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 38207 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:05.009105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:05.010339 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:05.017395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:05.017914 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:05.018749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:05.019653 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:05.108253 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8225e3d8-b5dc-45c8-b2f8-8c8566e8c3ed tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 38207 microversion: 2.20 time: 0.104703 Aug 27 04:13:05.108926 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 541/1117] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:05 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 38207 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:13:06.121308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:06.122188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:06.129145 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:06.129773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:06.130549 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:06.131003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:06.221887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f43b59d0-34a2-4bfc-a5e0-0afa9d85d6a2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 200 len: 38350 microversion: 2.20 time: 0.104727 Aug 27 04:13:06.223076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 577/1118] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:06 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 38350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:13:06.233860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:06.234438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:06.241618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:06.242063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:06.242860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:06.243292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:06.265804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e2293852-30d0-4e4e-bf3f-021febd1f4aa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/ips" status: 200 len: 152 microversion: 2.20 time: 0.035976 Aug 27 04:13:06.266355 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 542/1119] 10.222.0.73 () {60 vars in 1289 bytes} [Fri Aug 27 04:13:06 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:13:09.936876 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:09.937503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:09.944079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:09.944527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:09.945298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:09.945731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:09.968061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lazy-loading 'flavor' on Instance uuid a9ead420-d235-4428-bad2-4227cf9d52f9 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:13:10.548935 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0763b1e9-cae8-4dbb-825b-28ad7b6b62e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 202 len: 0 microversion: 2.20 time: 0.616014 Aug 27 04:13:10.549551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 578/1120] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:09 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:13:10.558747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:10.559366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:10.565722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:10.566174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:10.567085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:10.567483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:10.706704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:10.716164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:10.717821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:10.719089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-962c9ad2-0d94-4482-8604-f72e6a1f55f4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.164171 Aug 27 04:13:10.719677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 543/1121] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:10 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:11.740742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:11.741447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:11.747700 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:11.748213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:11.748995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:11.749427 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:11.872190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:11.882936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:11.884917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:11.886029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-30da831e-1c14-49bb-a83a-4ca162410c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.150702 Aug 27 04:13:11.886637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 579/1122] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:11 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:12.905210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:12.905854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:12.913117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:12.913566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:12.914375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:12.914833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:13.042819 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:13.050571 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:13.053503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:13.054708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4aa30370-8ad0-4c01-87ca-396d4c5c5b3e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.153278 Aug 27 04:13:13.055263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 544/1123] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:12 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:14.073499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:14.074098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:14.081308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:14.081800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:14.083220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:14.083831 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:14.234340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:14.244991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:14.246753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:14.247755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-062079ad-ec64-4091-a609-ee0c45f2e870 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.178279 Aug 27 04:13:14.248344 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 580/1124] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:14 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:15.267105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:15.267704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:15.273693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:15.274133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:15.274939 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:15.275368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:15.398614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:15.408709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:15.410240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:15.412607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1b3e1f10-921e-4dc7-8b32-2c15a030ae3a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.148115 Aug 27 04:13:15.413202 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 545/1125] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:15 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:16.431401 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:16.432007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:16.437837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:16.438279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:16.439066 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:16.439499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:16.652087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:16.659763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:16.661777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:16.662939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e52b0d33-7d03-4868-88f5-3b046ca27c2e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.236115 Aug 27 04:13:16.663504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 581/1126] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:16 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:17.681829 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:17.682429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:17.688707 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:17.689164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:17.689943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:17.690386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:17.866258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:17.874017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:17.875543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:17.876671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fbab4ef1-146f-4dc3-b35f-f486b302b7e3 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.199518 Aug 27 04:13:17.877234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 546/1127] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:17 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:18.895366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:18.896003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:18.902997 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:18.903448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:18.904213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:18.904653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:19.029164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:19.036895 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:19.038419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:19.039642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f2dec83c-f717-4713-8271-eb074dee43b2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.148015 Aug 27 04:13:19.040442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 582/1128] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:18 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:20.057798 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:20.058399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:20.064274 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:20.064719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:20.065484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:20.065911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:20.188512 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:20.196740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:20.198218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:20.199372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-84337bb3-7ce5-4e99-802f-b3857e29d32f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.145297 Aug 27 04:13:20.199918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 547/1129] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:20 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:21.218062 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:21.218784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:21.226415 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:21.227013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:21.228282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:21.228913 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:21.355244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:21.363051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:21.364569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:21.365800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-616ef4b1-7c5b-4830-a4d0-5564317abdcf tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.151593 Aug 27 04:13:21.366352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 583/1130] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:21 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:22.384469 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:22.385025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:22.390858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:22.391307 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:22.392073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:22.392509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:22.512279 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:22.520025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:22.521534 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:22.522690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-421d1596-9447-4869-b880-8aaccd9e318e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.142703 Aug 27 04:13:22.523239 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 548/1131] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:22 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:23.540687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:23.541237 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:23.547370 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:23.547822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:23.548593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:23.549030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:23.669948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:23.677781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:23.679704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:23.680865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-74811dfc-91ed-4af5-98eb-04e8533d7788 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1746 microversion: 2.20 time: 0.144090 Aug 27 04:13:23.681416 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 584/1132] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:23 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1746 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:13:24.699037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:24.699667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:24.705399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:24.705840 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:24.706625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:24.707057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:24.834412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:24.842584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:24.844093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:24.845259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4c609400-d44b-4101-a658-e9e05f4b7341 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1746 microversion: 2.20 time: 0.149957 Aug 27 04:13:24.845813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 549/1133] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:24 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:25.864547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:25.865878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:25.871695 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:25.872136 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:25.872898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:25.873321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:25.996086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:26.004119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:26.006454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:26.007634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-210c1ba4-dfd8-4529-aedc-45208434abfe tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1746 microversion: 2.20 time: 0.146838 Aug 27 04:13:26.008193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 585/1134] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:25 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1746 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:26.858000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-ed6dc948-2261-47fa-8d04-004cf9d34b07 req-070d021a-b3f3-4dce-8745-230b1d35fd02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "name": "network-vif-plugged", "status": "completed", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:26.867463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:26.867463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:13:26.867463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-ed6dc948-2261-47fa-8d04-004cf9d34b07 req-070d021a-b3f3-4dce-8745-230b1d35fd02 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:26.867463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-ed6dc948-2261-47fa-8d04-004cf9d34b07 req-070d021a-b3f3-4dce-8745-230b1d35fd02 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:26.877827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-ed6dc948-2261-47fa-8d04-004cf9d34b07 req-070d021a-b3f3-4dce-8745-230b1d35fd02 service nova] Creating event network-vif-plugged:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:13:26.883304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-ed6dc948-2261-47fa-8d04-004cf9d34b07 req-070d021a-b3f3-4dce-8745-230b1d35fd02 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029031 Aug 27 04:13:26.883877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 550/1135] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:27.144614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:27.145224 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:27.151728 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:27.152177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:27.152946 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:27.153377 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:27.273984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:27.281684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:27.283225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:27.284368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-43d71bdf-fb19-4cbf-af17-82578049bbe0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1746 microversion: 2.20 time: 0.262938 Aug 27 04:13:27.284918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 586/1136] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:27 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1746 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:28.304537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:28.305134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:28.311124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.311565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.312350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:28.312777 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:28.439906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:28.448396 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:28.449860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:28.451007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-895e91f6-0943-418f-9895-ef8c0d5cb614 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1746 microversion: 2.20 time: 0.151343 Aug 27 04:13:28.451558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 551/1137] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:28 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:29.469407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:29.470205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:29.476477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:29.476916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:29.477676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:29.478104 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:29.613200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:29.621957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:29.623552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:29.624690 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bbec4976-eb4b-4ab5-a6be-e6908203190f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1746 microversion: 2.20 time: 0.158991 Aug 27 04:13:29.625234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 587/1138] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:29 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:29.701575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1719526021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1777048250", "security_groups": [{"name": "tempest-secgroup-smoke-1607935804"}], "block_device_mapping_v2": [{"uuid": "2c1cd51f-5ddf-49c6-b7ae-42f152ddb0eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2bd2fb5-e4f2-41d4-8491-b54755281d6b"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:29.808852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] validate_networks() for [('c2bd2fb5-e4f2-41d4-8491-b54755281d6b', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:13:30.270034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:13:30.270801 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:13:30.272379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:13:30.272935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:13:30.273352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:13:30.283779 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:30.284292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:30.285093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:30.285521 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:30.306179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for project 98836f9ced7149bc904274a5add221ec. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:13:30.310940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for user 37ca683634884d9f8af26dba5bbea16f and project 98836f9ced7149bc904274a5add221ec. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:13:30.384797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:13:30.393410 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c1cd51f-5ddf-49c6-b7ae-42f152ddb0eb',volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:13:30.643431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:30.644044 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:30.652911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:30.653688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:30.654773 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:30.655206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:30.811085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-928e51f1-420e-4ca2-a082-db302deb90f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.112956 Aug 27 04:13:30.813292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 552/1139] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:13:29 2021] POST /compute/v2.1/servers => generated 406 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:13:30.828170 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-846f44bf-a3c4-459d-8fac-eee5ee79a5c5 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:30.829592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-846f44bf-a3c4-459d-8fac-eee5ee79a5c5 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:30.833403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:30.849811 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:30.851669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:30.852991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d69565af-11e4-4d23-a5c4-07cc2b174e6c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.214069 Aug 27 04:13:30.868156 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 588/1140] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:30 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:13:30.918893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-846f44bf-a3c4-459d-8fac-eee5ee79a5c5 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:30.929797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-846f44bf-a3c4-459d-8fac-eee5ee79a5c5 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1095 microversion: 2.1 time: 0.107693 Aug 27 04:13:30.930924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 553/1141] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:30 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1095 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:31.873509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:31.874179 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:31.886215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:31.886604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:31.887412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:31.887853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:31.950598 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:31.956685 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:31.969933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:31.970381 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:31.983554 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:31.984054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:32.069834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:32.088943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9f31672b-13e5-4488-858e-4bd478d33cb0 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1145 microversion: 2.1 time: 0.146633 Aug 27 04:13:32.099303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 554/1142] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:31 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1145 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:32.121025 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:32.133952 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:32.135756 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:32.137575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bd69456f-a1bc-4ae9-9793-3a36392b144e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.268647 Aug 27 04:13:32.140000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 589/1143] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:31 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:33.105858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:33.106485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:33.112729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:33.113183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:33.113965 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:33.114394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:33.160702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:33.161342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:33.169110 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:33.169623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:33.170585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:33.171020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:33.178250 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:33.186070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-56e8ddcc-bfec-4691-b07f-2252ee7bb0f9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1193 microversion: 2.1 time: 0.084002 Aug 27 04:13:33.187078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 555/1144] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:33 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:33.296585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:33.305314 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:33.306846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:33.307995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cc4f70c8-239d-4de1-b5c4-6c876fd6859e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.151186 Aug 27 04:13:33.308555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 590/1145] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:33 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:13:34.203844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:34.205234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:34.216397 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:34.217916 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:34.219421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:34.221257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:34.312747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:34.322015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6bf0a76c-f787-4850-b669-75a25160e11e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1211 microversion: 2.1 time: 0.122004 Aug 27 04:13:34.325233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 556/1146] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:34 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:34.337760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:34.338496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:34.348806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:34.351745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:34.352923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:34.355032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:34.498691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:34.506592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:34.513244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:34.514936 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0d36b08d-efc7-4746-bba0-e597a4913a23 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.192045 Aug 27 04:13:34.522213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 591/1147] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:34 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:35.341553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:35.342160 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:35.348095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:35.348824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:35.352317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:35.352317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:35.492079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:35.504827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-019e8001-2372-4819-98f5-75d627f3458c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1279 microversion: 2.1 time: 0.166419 Aug 27 04:13:35.506991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 557/1148] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:35 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:13:35.540593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:35.541916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:35.548223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:35.549026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:35.550048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:35.550751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:35.704333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:35.719663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:35.721516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:35.722974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-324cdb70-9c16-4fb0-a683-214fbced9ee6 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.186953 Aug 27 04:13:35.723748 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 592/1149] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:35 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:36.191037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-e2a3cf8c-cfd0-44b0-99d5-1007597aa64e req-f6ab2eed-e870-48a1-93d9-c7781410596a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4b2954-16f9-4141-9977-dd55b199c106", "tag": "bf689e8e-f7a7-472b-853a-879db5d6bce3"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:36.192697 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:36.192697 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:13:36.207278 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-e2a3cf8c-cfd0-44b0-99d5-1007597aa64e req-f6ab2eed-e870-48a1-93d9-c7781410596a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:36.207728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-e2a3cf8c-cfd0-44b0-99d5-1007597aa64e req-f6ab2eed-e870-48a1-93d9-c7781410596a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:36.228600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-e2a3cf8c-cfd0-44b0-99d5-1007597aa64e req-f6ab2eed-e870-48a1-93d9-c7781410596a service nova] Creating event network-changed:bf689e8e-f7a7-472b-853a-879db5d6bce3 for instance fc4b2954-16f9-4141-9977-dd55b199c106 on hv-cinder-80475 Aug 27 04:13:36.235870 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-e2a3cf8c-cfd0-44b0-99d5-1007597aa64e req-f6ab2eed-e870-48a1-93d9-c7781410596a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049715 Aug 27 04:13:36.237082 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 558/1150] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:36.523551 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:36.524471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:36.530981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:36.531655 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:36.532593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:36.533172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:36.664784 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:36.672198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4b2cf2cd-f208-4075-a336-93f33730918f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.152699 Aug 27 04:13:36.672766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 593/1151] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:36 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:36.744017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:36.744746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:36.751284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:36.751732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:36.752506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:36.752933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:36.883583 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:36.891516 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:36.893010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:36.894155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ff27f8b7-b666-45aa-b022-53908af9cf60 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.155274 Aug 27 04:13:36.894744 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 559/1152] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:36 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:37.691001 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:37.692643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:37.699676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:37.700249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:37.701446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:37.701983 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:37.865720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:37.873323 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2e4ba67b-c51f-4b4f-ad40-e8e9fb462304 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.187856 Aug 27 04:13:37.873926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 594/1153] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:37 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:37.913261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:37.913860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:37.920363 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:37.920813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:37.921599 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:37.922246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:38.066625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:38.076397 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:38.078233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:38.079854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5b29e000-5a49-48a1-af52-b13cac87196f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.170880 Aug 27 04:13:38.080620 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 560/1154] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:37 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:38.893538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:38.896812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:38.904181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:38.904865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:38.905845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:38.906418 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:39.060354 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:39.068930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a695e0c8-2973-420a-a4fd-19a46e24966e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.179414 Aug 27 04:13:39.069567 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 595/1155] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:38 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:39.100374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:39.101839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:39.108987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:39.110144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:39.111656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:39.112424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:39.272656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:39.281301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:39.283132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:39.284302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a6047b7e-ddce-4e01-ae5a-9c6425402225 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.188588 Aug 27 04:13:39.284852 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 561/1156] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:39 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:40.087799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:40.088580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:40.095235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:40.095785 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:40.096590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:40.097091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:40.249447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:40.257461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e6141ec8-7487-4906-88fa-fd531fcd67dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.173439 Aug 27 04:13:40.258229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 596/1157] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:40 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:40.303505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:40.304954 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:40.312350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:40.312800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:40.313582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:40.314013 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:40.460046 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:40.469581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:40.471625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:40.472988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-068e8666-7a8d-4206-bb9a-c0ace32c1c97 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.174155 Aug 27 04:13:40.474315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 562/1158] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:40 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:41.275251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:41.275867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:41.281752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:41.282202 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:41.282999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:41.283437 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:41.405320 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:41.413525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-16e7587a-a5d9-42cb-ad9d-2ed7e5ca4886 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.143020 Aug 27 04:13:41.414100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 597/1159] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:41 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:41.492133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:41.492735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:41.498529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:41.499012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:41.499785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:41.500223 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:41.623963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:41.632345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:41.633842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:41.635011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1095b700-4405-4efb-a4c3-34c5e71d3326 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1741 microversion: 2.20 time: 0.146580 Aug 27 04:13:41.635562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 563/1160] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:41 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1741 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:42.431008 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:42.431614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:42.437347 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:42.437801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:42.438599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:42.439043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:42.559387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:42.566642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fa87579f-6c72-4a0d-b89f-124497db4f2c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.140381 Aug 27 04:13:42.567369 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 598/1161] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:42 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:42.654310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:42.654915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:42.660860 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:42.661351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:42.662143 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:42.662608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:42.791157 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:42.799311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:42.800883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:42.803005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-320f44c4-e657-40e8-84f9-c61244a83948 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1723 microversion: 2.20 time: 0.151423 Aug 27 04:13:42.803465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 564/1162] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:42 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:43.584159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:43.584804 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:43.590732 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:43.591191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:43.591964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:43.592407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:43.707643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:43.715793 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bee1a759-8487-4974-8ed7-2d807fa44cac tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.135890 Aug 27 04:13:43.716353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 599/1163] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:43 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:43.821837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:43.822471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:43.828395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:43.828841 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:43.829603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:43.830029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:43.958893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:43.965019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:43.966544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:43.967695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5255ce6a-794c-443f-9e9a-572f85ea4fd2 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1723 microversion: 2.20 time: 0.150290 Aug 27 04:13:43.975477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 565/1164] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:43 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:44.734960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:44.736147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:44.743534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:44.743982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:44.744764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:44.745221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:44.870495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:44.877687 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cb1b6fe1-d373-4345-8db6-eeea7ea9e4a2 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.148023 Aug 27 04:13:44.878262 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 600/1165] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:44 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:44.985450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:44.986053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:44.992052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:44.992511 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:44.993300 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:44.993738 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:45.113035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:45.120927 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:45.122423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:45.123668 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4eb3955e-281e-411b-80c9-d79e5d121d8f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1726 microversion: 2.20 time: 0.142014 Aug 27 04:13:45.124212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 566/1166] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:44 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1726 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:45.145555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5d24eb1-2783-42a7-9df3-1cf46e560d6d"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:45.147325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:45.153280 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:45.153731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:45.154498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:45.154969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:45.893830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:45.894432 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:45.900251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:45.907219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:45.907219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:45.907219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:46.022992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:46.030503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e6fada3a-7003-4966-a16f-e77d75213f28 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.140417 Aug 27 04:13:46.031111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 567/1167] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:45 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:13:46.301208 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f86dc1b7-597d-4e4d-8362-b0806e340955 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.159423 Aug 27 04:13:46.301823 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 601/1168] 10.222.0.73 () {62 vars in 1364 bytes} [Fri Aug 27 04:13:45 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-volume_attachments => generated 188 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:13:46.423137 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:46.423632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:46.430234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:46.430732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:46.431504 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:46.431945 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:46.999247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-0d584336-8db1-4a88-b5d0-d672deacbe16 req-b11033f6-7aed-4033-951a-29fca05358de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4b2954-16f9-4141-9977-dd55b199c106", "name": "network-vif-plugged", "status": "completed", "tag": "bf689e8e-f7a7-472b-853a-879db5d6bce3"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:47.000837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:47.000837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:13:47.009369 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-0d584336-8db1-4a88-b5d0-d672deacbe16 req-b11033f6-7aed-4033-951a-29fca05358de service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.013017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-0d584336-8db1-4a88-b5d0-d672deacbe16 req-b11033f6-7aed-4033-951a-29fca05358de service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.020932 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-0d584336-8db1-4a88-b5d0-d672deacbe16 req-b11033f6-7aed-4033-951a-29fca05358de service nova] Creating event network-vif-plugged:bf689e8e-f7a7-472b-853a-879db5d6bce3 for instance fc4b2954-16f9-4141-9977-dd55b199c106 on hv-cinder-80475 Aug 27 04:13:47.026883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-0d584336-8db1-4a88-b5d0-d672deacbe16 req-b11033f6-7aed-4033-951a-29fca05358de service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031195 Aug 27 04:13:47.027479 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 602/1169] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:13:47.050178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:47.050907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:47.057155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.057607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.058373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.058863 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.102125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-560ddea5-0c4b-4c4a-b6c2-b8c6b9d48c89 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-volume_attachments/d5d24eb1-2783-42a7-9df3-1cf46e560d6d" status: 202 len: 0 microversion: 2.20 time: 0.682328 Aug 27 04:13:47.103398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 568/1170] 10.222.0.73 () {60 vars in 1457 bytes} [Fri Aug 27 04:13:46 2021] DELETE /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-volume_attachments/d5d24eb1-2783-42a7-9df3-1cf46e560d6d => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:13:47.167849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:47.168419 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:47.175686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.176206 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.176914 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.177558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.220007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:47.228829 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c9ad0658-30c7-44be-a27a-b0625aed3275 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.182345 Aug 27 04:13:47.229909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 603/1171] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:47 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:13:47.425578 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6863c553-60ed-4557-a092-df1e930016ef tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action" status: 202 len: 0 microversion: 2.20 time: 0.261426 Aug 27 04:13:47.426493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 569/1172] 10.222.0.73 () {62 vars in 1319 bytes} [Fri Aug 27 04:13:47 2021] POST /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:13:47.435306 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:47.435927 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:47.441679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.442688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.442917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:47.443429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:47.565382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:47.573654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:47.575196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:47.576330 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-41c3ea2c-f8b6-41ab-b7d3-a93cdbfe14e5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1674 microversion: 2.20 time: 0.144756 Aug 27 04:13:47.576876 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 604/1173] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:47 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:48.245408 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:48.246000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:48.251756 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:48.252323 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:48.253095 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:48.253574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:48.377183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:48.385067 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-08ead835-32e1-41e5-8b0a-a4da326603ee tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1267 microversion: 2.1 time: 0.143428 Aug 27 04:13:48.385634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 570/1174] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:48 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:13:48.594550 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:48.595139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:48.601198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:48.601655 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:48.602432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:48.602887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:48.723476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:48.732693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:48.734195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:48.736219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-337be20e-4167-4e11-bcc2-4883a0f1418c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1676 microversion: 2.20 time: 0.145542 Aug 27 04:13:48.736780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 605/1175] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:48 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1676 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:49.041953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-33cd32f7-336c-475e-8d74-8a9dc3ab6d2e req-7c767f2c-2d2b-41d6-9ace-1a8e9e0e219c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "name": "network-vif-unplugged", "status": "completed", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:49.043565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:49.043565 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:13:49.050229 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-33cd32f7-336c-475e-8d74-8a9dc3ab6d2e req-7c767f2c-2d2b-41d6-9ace-1a8e9e0e219c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.050708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-33cd32f7-336c-475e-8d74-8a9dc3ab6d2e req-7c767f2c-2d2b-41d6-9ace-1a8e9e0e219c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.061563 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-33cd32f7-336c-475e-8d74-8a9dc3ab6d2e req-7c767f2c-2d2b-41d6-9ace-1a8e9e0e219c service nova] Creating event network-vif-unplugged:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:13:49.066582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-33cd32f7-336c-475e-8d74-8a9dc3ab6d2e req-7c767f2c-2d2b-41d6-9ace-1a8e9e0e219c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028290 Aug 27 04:13:49.067198 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 571/1176] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:13:49.402456 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:49.403231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:49.408914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.409358 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.410134 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.410594 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.534032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:49.539373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f897dac0-88ae-407f-9996-d8e5fa974ac7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1452 microversion: 2.1 time: 0.140557 Aug 27 04:13:49.539949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 606/1177] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:49 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:49.556218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:49.556970 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:49.564082 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.564535 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.565309 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.565740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.690258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:49.697614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-40c034ff-c611-4211-a028-5b36eda810e3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1452 microversion: 2.1 time: 0.146028 Aug 27 04:13:49.698179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 572/1178] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:13:49 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:13:49.755521 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:49.756509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:49.762862 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.763390 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.764243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:49.764750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:49.905203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:49.913736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:49.915277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:49.916438 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5c2ddc84-1ffd-4e34-b90a-04231a5c3a01 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.164659 Aug 27 04:13:49.916993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 607/1179] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:49 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:50.939278 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:50.941059 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:50.948592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:50.949134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:50.950093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:50.950533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:51.234723 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:51.242882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:51.244366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:51.245488 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-582da074-93cd-4b65-b61f-f2c41877130c tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.313725 Aug 27 04:13:51.246030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 573/1180] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:50 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:52.263722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:52.264333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:52.270229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:52.270720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:52.272449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:52.273284 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:52.442151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-1cb9a1f3-6d9a-49c5-89f9-c338e0899eb2 req-b9424159-b673-4eb6-a657-28a39d5d6ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4b2954-16f9-4141-9977-dd55b199c106", "tag": "bf689e8e-f7a7-472b-853a-879db5d6bce3"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:13:52.446176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:13:52.446176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:13:52.463164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-1cb9a1f3-6d9a-49c5-89f9-c338e0899eb2 req-b9424159-b673-4eb6-a657-28a39d5d6ed7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:52.464267 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-1cb9a1f3-6d9a-49c5-89f9-c338e0899eb2 req-b9424159-b673-4eb6-a657-28a39d5d6ed7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:52.484793 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-1cb9a1f3-6d9a-49c5-89f9-c338e0899eb2 req-b9424159-b673-4eb6-a657-28a39d5d6ed7 service nova] Creating event network-changed:bf689e8e-f7a7-472b-853a-879db5d6bce3 for instance fc4b2954-16f9-4141-9977-dd55b199c106 on hv-cinder-80475 Aug 27 04:13:52.494541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-1cb9a1f3-6d9a-49c5-89f9-c338e0899eb2 req-b9424159-b673-4eb6-a657-28a39d5d6ed7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057996 Aug 27 04:13:52.496483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 574/1181] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:13:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:13:52.534618 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:52.543131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:52.544661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:52.545902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-71f4f147-17f8-4d0f-bdc7-c0465b11c4fc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.285810 Aug 27 04:13:52.546753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 608/1182] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:52 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:53.565659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:53.566532 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:53.574319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:53.575016 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:53.575998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:53.576505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:53.727034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:53.737246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:53.739260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:53.740672 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-85910622-ab2b-4d43-8e8f-fd28624fd7f7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.179026 Aug 27 04:13:53.742155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 575/1183] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:53 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:54.760226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:54.761987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:54.769020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:54.769477 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:54.770297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:54.770951 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:54.895897 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:54.904763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:54.906369 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:54.907676 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7b680ab8-97d2-4d79-806b-52698ee35ed5 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.152310 Aug 27 04:13:54.908309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 609/1184] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:54 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:55.926694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:55.927582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:55.934210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:55.934693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:55.935468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:55.935898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:56.072215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:56.079825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:56.081298 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:56.082421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fac1a52b-f038-4cc7-ba8d-ca7b3fb93faa tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.159574 Aug 27 04:13:56.083005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 576/1185] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:55 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:57.102220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:57.102975 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:57.109599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:57.110056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:57.110873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:57.111310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:57.277474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:57.288652 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:57.290934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:57.292475 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-51c3690b-b6dd-4ffd-b69b-6ab12d838494 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.195090 Aug 27 04:13:57.305763 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 610/1186] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:57 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:58.314348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:58.314941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:58.321541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:58.321991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:58.322786 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:58.323238 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:58.452295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:58.460315 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:58.461807 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:58.462966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-adb83461-4b60-4963-84f4-59f53db7b693 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.152463 Aug 27 04:13:58.463514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 577/1187] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:58 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:13:59.488333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:13:59.488333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:13:59.492873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:59.493465 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:59.494454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:13:59.495063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:13:59.630076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:59.638000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:59.639527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:13:59.640707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-df52cc1a-6d8d-48f7-bdc4-d7938d9aca9d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.163948 Aug 27 04:13:59.641271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 611/1188] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:13:59 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:00.659441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:00.660194 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:00.666403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:00.666992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:00.667883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:00.668366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:00.796038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:00.804386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:00.805882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:00.807186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a465906c-f43c-412e-a986-d5b4728e26c0 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.151746 Aug 27 04:14:00.807740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 578/1189] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:00 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:14:01.824762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:01.825373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:01.831235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:01.831685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:01.832451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:01.832881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:01.953674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:01.964214 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:01.965710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:01.966878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a235c297-cc72-4dde-bfeb-7231ca5c565f tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.145827 Aug 27 04:14:01.967436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 612/1190] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:01 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:02.985124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:02.985734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:02.992581 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:02.994679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:02.994679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:02.994679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:03.116232 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:03.123805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:03.125283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:03.126402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b6abf40a-36ac-49d4-88d1-b3d010c558ba tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.145118 Aug 27 04:14:03.126988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 579/1191] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:02 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:04.145095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:04.145802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:04.152294 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:04.152742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:04.153525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:04.153953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:04.284219 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:04.293326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:04.294885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:04.296191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-68357ec1-a5c1-43d4-bef8-74758a5db30d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.154712 Aug 27 04:14:04.296882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 613/1192] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:04 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:05.315290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:05.315888 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:05.322584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:05.323041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:05.323811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:05.324247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:05.443784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:05.451411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:05.452925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:05.454056 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-186432e1-b0fa-4e18-973e-ce719159a198 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.142518 Aug 27 04:14:05.454629 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 580/1193] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:05 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:06.472128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:06.472746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:06.478750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:06.479205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:06.479975 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:06.480414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:06.599949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:06.607798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:06.609342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:06.610494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b159e27d-bd62-4b16-8076-67ac73932c74 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.142122 Aug 27 04:14:06.611078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 614/1194] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:06 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:07.628340 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:07.628941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:07.634998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:07.635447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:07.636210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:07.636638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:07.759471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:07.767040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:07.768546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:07.769691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5cf106c1-65f3-4941-ab9e-99b01f14cf09 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.145109 Aug 27 04:14:07.770258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 581/1195] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:07 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:08.789246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:08.789950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:08.796009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:08.796455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:08.797241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:08.797673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:08.924925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:08.933257 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:08.934790 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:08.935941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-60b96b28-917a-4c32-8ed0-c4751c5c6175 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.151153 Aug 27 04:14:08.936497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 615/1196] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:08 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:09.068430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-6ae1bdec-494f-4325-8d42-9f4c5b9483fb req-e716ec16-d782-4d7f-a6ac-11a793f5897c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "name": "network-vif-plugged", "status": "completed", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:14:09.070194 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:14:09.070194 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:14:09.077046 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-6ae1bdec-494f-4325-8d42-9f4c5b9483fb req-e716ec16-d782-4d7f-a6ac-11a793f5897c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:09.077492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-6ae1bdec-494f-4325-8d42-9f4c5b9483fb req-e716ec16-d782-4d7f-a6ac-11a793f5897c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:09.089633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-6ae1bdec-494f-4325-8d42-9f4c5b9483fb req-e716ec16-d782-4d7f-a6ac-11a793f5897c service nova] Creating event network-vif-plugged:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:14:09.097189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-6ae1bdec-494f-4325-8d42-9f4c5b9483fb req-e716ec16-d782-4d7f-a6ac-11a793f5897c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091900 Aug 27 04:14:09.097189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 582/1197] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:14:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:14:09.954635 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:09.955240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:09.962199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:09.962678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:09.963451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:09.963875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:10.091178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:10.098837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:10.100338 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:10.101623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8a8fe621-9467-4879-a570-14f88b7fe5be tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.150716 Aug 27 04:14:10.102178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 616/1198] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:09 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:11.121165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:11.121873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:11.128228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:11.128691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:11.129469 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:11.129906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:11.270645 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:11.278819 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:11.280301 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:11.281420 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1e0d294d-89bd-481b-ae40-abdc390c6079 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1732 microversion: 2.20 time: 0.165762 Aug 27 04:14:11.281974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 583/1199] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:11 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:12.299345 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:14:12.300061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:14:12.306281 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:12.306802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:12.307571 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:14:12.307997 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:14:12.428622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:12.436335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:12.437827 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:14:12.438988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ad9973e2-0920-4657-95fe-03f7a2b1705a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1719 microversion: 2.20 time: 0.143320 Aug 27 04:14:12.439559 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 617/1200] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:14:12 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1719 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:14:42.704779 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:14:42.705428 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:14:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:15:08.048882 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:15:08.049515 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:15:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:15:17.274923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05368f9e-b724-4253-88eb-17bdbbcdc98a] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:15:17.278387 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:17.279302 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:17.285149 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:17.285597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:17.286366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:17.286949 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:17.315692 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1cb75352-2fc3-4137-899a-34b67ebc299e tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042935 Aug 27 04:15:17.316244 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 584/1201] 10.222.0.73 () {60 vars in 1343 bytes} [Fri Aug 27 04:15:17 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:17.377105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d549f506-4416-46b2-8a80-d941453b9595] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:15:17.378508 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:17.379039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:17.386347 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:17.386828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:17.387607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:17.388038 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:17.413006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:15:17.691108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6c18b243-5528-4cd0-aa41-afee277702dd tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 204 len: 0 microversion: 2.20 time: 0.317638 Aug 27 04:15:17.691698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 618/1202] 10.222.0.73 () {60 vars in 1280 bytes} [Fri Aug 27 04:15:17 2021] DELETE /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:15:17.700861 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:17.701472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:17.707373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:17.707816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:17.708579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:17.709036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:17.845733 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:17.855594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:17.857106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:17.858260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0c580575-3521-4582-9124-13e8c2d07aa7 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.161160 Aug 27 04:15:17.858850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 585/1203] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:15:17 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:15:18.877601 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:18.878294 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:18.897688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:18.898779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:18.899577 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:18.900010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:18.924237 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] [d549f506-4416-46b2-8a80-d941453b9595] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40664. Aug 27 04:15:19.034968 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:19.043581 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:19.045063 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:19.046194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-06569efc-2f5e-4f67-8639-f171c3d9ce75 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.172736 Aug 27 04:15:19.046766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 619/1204] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:15:18 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:15:20.064071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:20.064673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:20.082141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:20.082602 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:20.083388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:20.083810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:20.090418 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] [05368f9e-b724-4253-88eb-17bdbbcdc98a] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 40668. Aug 27 04:15:20.212997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:20.221724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:20.223275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:20.224314 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9a6a7a22-bb3b-4a6e-ae87-4992f0e03973 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1725 microversion: 2.20 time: 0.163929 Aug 27 04:15:20.226741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 586/1205] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:15:20 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 27 04:15:20.618246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-cf1f1680-fc80-417f-988d-00215e878502 req-f9aa2842-7198-4aac-8a23-362255182a00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9ead420-d235-4428-bad2-4227cf9d52f9", "name": "network-vif-deleted", "tag": "599e01ec-6e79-4726-bd8b-42c115595f00"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:20.619929 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:15:20.619929 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:15:20.627431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-cf1f1680-fc80-417f-988d-00215e878502 req-f9aa2842-7198-4aac-8a23-362255182a00 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:20.627875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-cf1f1680-fc80-417f-988d-00215e878502 req-f9aa2842-7198-4aac-8a23-362255182a00 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:20.640254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-cf1f1680-fc80-417f-988d-00215e878502 req-f9aa2842-7198-4aac-8a23-362255182a00 service nova] Creating event network-vif-deleted:599e01ec-6e79-4726-bd8b-42c115595f00 for instance a9ead420-d235-4428-bad2-4227cf9d52f9 on hv-cinder-80475 Aug 27 04:15:20.645652 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-cf1f1680-fc80-417f-988d-00215e878502 req-f9aa2842-7198-4aac-8a23-362255182a00 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160050 Aug 27 04:15:20.646529 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 620/1206] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:21.243640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:21.244192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:21.250015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:21.250472 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:21.251289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:21.254819 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:21.287441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:21.287892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:21.288975 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lazy-loading 'fault' on Instance uuid a9ead420-d235-4428-bad2-4227cf9d52f9 {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:15:21.332442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:21.344575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:21.346341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6463ded3d09e4dbd908f0d03b20e0555', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74bc40decbba46aba88aa9c29c8858d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:21.347809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-25be2427-0c0f-4a65-9d51-34c80476a53a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 200 len: 1372 microversion: 2.20 time: 0.108651 Aug 27 04:15:21.348619 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 587/1207] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:15:21 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 27 04:15:22.367444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:22.368078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:22.374351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:22.374841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:22.375629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:22.376071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:22.389758 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] HTTP exception thrown: Instance a9ead420-d235-4428-bad2-4227cf9d52f9 could not be found. Aug 27 04:15:22.390356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Returning 404 to user: Instance a9ead420-d235-4428-bad2-4227cf9d52f9 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:15:22.391221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5802e543-401c-4b31-8eac-050840e23349 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 404 len: 111 microversion: 2.20 time: 0.027951 Aug 27 04:15:22.391757 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 621/1208] 10.222.0.73 () {60 vars in 1277 bytes} [Fri Aug 27 04:15:22 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:15:22.400626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-67dee121-8d60-4134-87e3-432d24225e0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '.version_select at 0x7f538e2be700>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:22.527328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-67dee121-8d60-4134-87e3-432d24225e0d tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884324913" status: 204 len: 0 microversion: 2.20 time: 0.130952 Aug 27 04:15:22.527909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 588/1209] 10.222.0.73 () {60 vars in 1262 bytes} [Fri Aug 27 04:15:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1884324913 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 27 04:15:24.600704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:24.601812 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:24.607828 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:24.608272 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:24.609040 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:24.609473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:24.623240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] HTTP exception thrown: Instance a9ead420-d235-4428-bad2-4227cf9d52f9 could not be found. Aug 27 04:15:24.623822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Returning 404 to user: Instance a9ead420-d235-4428-bad2-4227cf9d52f9 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:15:24.624638 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6e53774c-b2d6-4243-9fdc-8b9e682256d4 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 404 len: 111 microversion: 2.1 time: 0.027593 Aug 27 04:15:24.625164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 622/1210] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:15:24 2021] DELETE /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:15:24.633333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:24.633968 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: a9ead420-d235-4428-bad2-4227cf9d52f9] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:24.639923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:24.640378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:24.641152 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:24.641590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:24.655957 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] HTTP exception thrown: Instance a9ead420-d235-4428-bad2-4227cf9d52f9 could not be found. Aug 27 04:15:24.656548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Returning 404 to user: Instance a9ead420-d235-4428-bad2-4227cf9d52f9 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:15:24.657367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-94f479da-b499-435f-abea-4f5a1b74734a tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9" status: 404 len: 111 microversion: 2.1 time: 0.028163 Aug 27 04:15:24.657896 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 589/1211] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:24 2021] GET /compute/v2.1/servers/a9ead420-d235-4428-bad2-4227cf9d52f9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:15:25.911418 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:25.911945 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:25.917734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:25.918181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:25.918981 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:25.919413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:25.932995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] HTTP exception thrown: Instance eb257852-e7be-425c-b86c-f65f49093cbf could not be found. Aug 27 04:15:25.933569 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Returning 404 to user: Instance eb257852-e7be-425c-b86c-f65f49093cbf could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:15:25.934371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-870af1b2-2161-4791-8361-2efe2667bd19 tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "DELETE /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 404 len: 111 microversion: 2.1 time: 0.026734 Aug 27 04:15:25.934920 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 623/1212] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:15:25 2021] DELETE /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 27 04:15:25.942444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:25.943086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] [instance: eb257852-e7be-425c-b86c-f65f49093cbf] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:25.949385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:25.949827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:25.950599 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:25.951031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:25.963799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] HTTP exception thrown: Instance eb257852-e7be-425c-b86c-f65f49093cbf could not be found. Aug 27 04:15:25.964363 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] Returning 404 to user: Instance eb257852-e7be-425c-b86c-f65f49093cbf could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:15:25.965158 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3011e87b-fb40-446a-aca3-2f39951dc4dc tempest-AttachVolumeShelveTestJSON-726641964 tempest-AttachVolumeShelveTestJSON-726641964-project] 10.222.0.73 "GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf" status: 404 len: 111 microversion: 2.1 time: 0.026378 Aug 27 04:15:25.965673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 590/1213] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:25 2021] GET /compute/v2.1/servers/eb257852-e7be-425c-b86c-f65f49093cbf => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:15:37.247774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-51f41777-2ace-4920-8843-9bc8a7c8aca6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: .version_select at 0x7f538e669280>, body: {"keypair": {"name": "tempest-keypair-866413771"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:37.266801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-51f41777-2ace-4920-8843-9bc8a7c8aca6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:15:37.271152 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-51f41777-2ace-4920-8843-9bc8a7c8aca6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for user 1eee45d5e088466d8ebf58a9755ea45d and project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:15:37.487799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-51f41777-2ace-4920-8843-9bc8a7c8aca6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:15:37.492433 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-51f41777-2ace-4920-8843-9bc8a7c8aca6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for user 1eee45d5e088466d8ebf58a9755ea45d and project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:15:37.505287 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-51f41777-2ace-4920-8843-9bc8a7c8aca6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.397523 Aug 27 04:15:37.505881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 624/1214] 10.222.0.73 () {60 vars in 1158 bytes} [Fri Aug 27 04:15:37 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:39.918584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1057516581", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70ebb7eb-7166-412b-a492-12027e1cc0b5"}], "security_groups": [{"name": "tempest-securitygroup--1213416318"}], "key_name": "tempest-keypair-866413771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:40.029402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] validate_networks() for [('70ebb7eb-7166-412b-a492-12027e1cc0b5', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:15:40.419700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:15:40.420125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:15:40.420597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:15:40.421010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:15:40.421423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:15:40.430844 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:40.431295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:40.432097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:40.432529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:40.451064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:15:40.456559 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for user 1eee45d5e088466d8ebf58a9755ea45d and project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:15:40.469416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:15:40.471818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:15:40.616429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9e4382fa-0cd2-4b57-ab0c-6ffe69f80fa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701567 Aug 27 04:15:40.617635 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 591/1215] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:15:39 2021] POST /compute/v2.1/servers => generated 402 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:15:40.628417 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-709805a7-f549-4bf0-b583-eafe25d271cc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:40.629060 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-709805a7-f549-4bf0-b583-eafe25d271cc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:40.685238 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-709805a7-f549-4bf0-b583-eafe25d271cc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:40.693045 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-709805a7-f549-4bf0-b583-eafe25d271cc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1237 microversion: 2.1 time: 0.069526 Aug 27 04:15:40.693607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 625/1216] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:40 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:41.711036 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:41.712241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:41.718800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:41.719255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:41.720054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:41.720474 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:41.779045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:41.786257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f98d3abc-384b-40ba-b731-007fa6e76405 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1241 microversion: 2.1 time: 0.079535 Aug 27 04:15:41.786846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 592/1217] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:41 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:15:42.802965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:42.804392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:42.810294 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:42.810779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:42.811543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:42.812020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:42.876984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:42.885959 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1c8f3c78-ba3a-4390-bf44-d600df8ae13d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1241 microversion: 2.1 time: 0.086587 Aug 27 04:15:42.886525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 626/1218] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:42 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:43.903378 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:43.903989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:43.910043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:43.910407 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:43.911217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:43.911899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:43.975328 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:43.981822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f6ce3eae-eb25-4782-9080-3d77810d3de7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1307 microversion: 2.1 time: 0.081984 Aug 27 04:15:43.982399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 593/1219] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:43 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1307 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:45.002365 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:45.003113 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:45.009874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:45.010742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:45.011614 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:45.012218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:45.141047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:45.149606 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-53f0b444-d5f0-4571-8997-f4100d07e200 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.155071 Aug 27 04:15:45.150554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 627/1220] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:44 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:45.275185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-f5ac2486-edf6-426e-b5f7-76583744de0c req-7f9d0a7a-39a4-4d06-a03d-a2aa684c1046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45894587-8bff-45cc-ab9f-b8ec963e6ae5", "tag": "3fce287d-dfc5-4a0d-8882-b3e2a759aef8"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:45.276754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:15:45.276754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:15:45.284251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-f5ac2486-edf6-426e-b5f7-76583744de0c req-7f9d0a7a-39a4-4d06-a03d-a2aa684c1046 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:45.284694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-f5ac2486-edf6-426e-b5f7-76583744de0c req-7f9d0a7a-39a4-4d06-a03d-a2aa684c1046 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:45.297497 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-f5ac2486-edf6-426e-b5f7-76583744de0c req-7f9d0a7a-39a4-4d06-a03d-a2aa684c1046 service nova] Creating event network-changed:3fce287d-dfc5-4a0d-8882-b3e2a759aef8 for instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 on hv-cinder-80475 Aug 27 04:15:45.303501 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-f5ac2486-edf6-426e-b5f7-76583744de0c req-7f9d0a7a-39a4-4d06-a03d-a2aa684c1046 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032279 Aug 27 04:15:45.305111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 594/1221] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:46.170385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:46.171024 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:46.176893 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:46.177337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:46.178263 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:46.179656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:46.304389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:46.311494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e59eb7cb-af23-48fa-84ef-1b317b805c30 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.145215 Aug 27 04:15:46.312064 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 628/1222] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:46 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:47.328595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:47.329290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:47.335404 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:47.335850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:47.336615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:47.337051 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:47.463183 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:47.470465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1f6ac1b4-fca8-48de-80f4-489e05004945 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.145829 Aug 27 04:15:47.471058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 595/1223] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:47 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:48.488072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:48.488716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:48.496139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:48.496588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:48.497366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:48.497791 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:48.618389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:48.625589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d3c719d4-7b53-45c0-9cfb-c63c2055d125 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.141261 Aug 27 04:15:48.626161 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 629/1224] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:48 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:49.642089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:49.642708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:49.649196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:49.649644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:49.650421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:49.650888 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:49.769724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:49.777726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c2dc7e64-7997-4629-a98a-efbe3348e386 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.139349 Aug 27 04:15:49.778280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 596/1225] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:49 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:50.794503 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:50.795065 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:50.800903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:50.801347 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:50.802112 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:50.802543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:50.927912 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:50.935930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8752f767-907e-4ab4-8d9b-fdc91fa364f6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.145330 Aug 27 04:15:50.936483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 630/1226] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:50 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:51.587405 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-44ef7b11-ae07-47ef-855f-4830b9a1eabd req-3d6dfaf7-ed0b-40c9-bdd9-89222b3915ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45894587-8bff-45cc-ab9f-b8ec963e6ae5", "name": "network-vif-plugged", "status": "completed", "tag": "3fce287d-dfc5-4a0d-8882-b3e2a759aef8"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:51.588901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:15:51.588901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:15:51.596019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-44ef7b11-ae07-47ef-855f-4830b9a1eabd req-3d6dfaf7-ed0b-40c9-bdd9-89222b3915ae service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:51.596496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-44ef7b11-ae07-47ef-855f-4830b9a1eabd req-3d6dfaf7-ed0b-40c9-bdd9-89222b3915ae service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:51.607700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-44ef7b11-ae07-47ef-855f-4830b9a1eabd req-3d6dfaf7-ed0b-40c9-bdd9-89222b3915ae service nova] Creating event network-vif-plugged:3fce287d-dfc5-4a0d-8882-b3e2a759aef8 for instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 on hv-cinder-80475 Aug 27 04:15:51.612654 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-44ef7b11-ae07-47ef-855f-4830b9a1eabd req-3d6dfaf7-ed0b-40c9-bdd9-89222b3915ae service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 Aug 27 04:15:51.613340 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 597/1227] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:15:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:51.953052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:51.953674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:51.959956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:51.960526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:51.961353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:51.961789 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:52.083517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:52.092747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-fa3b682c-2ee7-4d01-ab49-16c17ecea3e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.143263 Aug 27 04:15:52.093329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 631/1228] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:51 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:53.116821 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:53.117527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:53.123642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:53.124098 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:53.124871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:53.125337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:53.250662 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:53.257853 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6c0aa8a1-af3b-49e6-a268-815cbaaa3bb5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1363 microversion: 2.1 time: 0.145645 Aug 27 04:15:53.258419 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 598/1229] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:53 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:54.274708 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:54.275248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:54.281155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:54.281604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:54.282371 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:54.282832 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:54.404487 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:15:54.411861 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f4c396aa-f6af-4935-b259-94766ebbdffd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1549 microversion: 2.1 time: 0.140860 Aug 27 04:15:54.412169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 632/1230] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:15:54 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1549 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:15:54.427978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:15:54.429402 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:54.434542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:54.435021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:54.435785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:54.436217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:54.524350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7266dc79-be7b-41c0-b379-14baf3cab040 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099922 Aug 27 04:15:54.524998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 599/1231] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Aug 27 04:15:54 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:55.501009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:55.501920 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:55.508195 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-934e28c0-b95d-469f-aefa-aeafa3188d5b req-4282737f-5418-4c02-a1b5-9f2d1da4a883 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45894587-8bff-45cc-ab9f-b8ec963e6ae5", "tag": "3fce287d-dfc5-4a0d-8882-b3e2a759aef8"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:55.509724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:15:55.509724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:15:55.517049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-934e28c0-b95d-469f-aefa-aeafa3188d5b req-4282737f-5418-4c02-a1b5-9f2d1da4a883 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:55.517584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:55.517768 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-934e28c0-b95d-469f-aefa-aeafa3188d5b req-4282737f-5418-4c02-a1b5-9f2d1da4a883 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:55.518040 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:55.518926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:55.519285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:55.530434 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-934e28c0-b95d-469f-aefa-aeafa3188d5b req-4282737f-5418-4c02-a1b5-9f2d1da4a883 service nova] Creating event network-changed:3fce287d-dfc5-4a0d-8882-b3e2a759aef8 for instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 on hv-cinder-80475 Aug 27 04:15:55.535832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-934e28c0-b95d-469f-aefa-aeafa3188d5b req-4282737f-5418-4c02-a1b5-9f2d1da4a883 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031955 Aug 27 04:15:55.537271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 600/1232] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:15:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:15:55.619178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f05b5875-2db5-4c7b-9af5-d9f0c9403c80 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.121257 Aug 27 04:15:55.619720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 633/1233] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:15:55 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:15:56.629643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:56.630667 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:56.638134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:56.638643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:56.639423 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:56.639864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:56.719659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bb888597-adba-4d4e-a904-73d9b1476ada tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.093811 Aug 27 04:15:56.720309 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 601/1234] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:15:56 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:15:57.731678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:57.732588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:57.739035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:57.739491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:57.740265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:57.741395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:57.819885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cd04ed6c-00d7-43b5-905c-8e95c5925498 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.092181 Aug 27 04:15:57.820502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 634/1235] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:15:57 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:15:58.831277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:58.832168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:58.838516 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:58.838992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:58.839754 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:58.840185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:58.929991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6fc4d396-f6ce-46ed-8eae-7de451baa94e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.102641 Aug 27 04:15:58.930655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 602/1236] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:15:58 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:15:59.941560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:15:59.942597 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:15:59.950015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:59.950470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:15:59.951277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:15:59.951720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:00.033706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-79b6864f-0e5d-43df-9102-d3f797f30249 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.096046 Aug 27 04:16:00.034353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 635/1237] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:15:59 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:16:01.045496 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:01.046487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:01.053621 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:01.054594 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:01.055390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:01.055834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:01.136227 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-847cdfa5-e8c4-472e-8c7a-b25c87471609 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.094692 Aug 27 04:16:01.136880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 603/1238] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:01 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:16:02.147768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:02.148766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:02.155310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:02.155765 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:02.156547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:02.156995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:02.243168 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-39a55b31-ae88-4668-8d1c-6665bf8a7e14 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.099303 Aug 27 04:16:02.243742 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 636/1239] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:02 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:16:03.254430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:03.255390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:03.262389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:03.262880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:03.263655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:03.264093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:03.359013 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cc2dd679-8fab-45c3-a15e-af111fbaa226 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.108542 Aug 27 04:16:03.359694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 604/1240] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:03 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:16:04.372409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:04.373321 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:04.379800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:04.380256 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:04.381846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:04.382293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:04.465384 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0bb19c5f-f92d-448b-93de-7fbb25190afe tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.098233 Aug 27 04:16:04.466004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 637/1241] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:04 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:16:05.477245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:05.478286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:05.484813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:05.485269 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:05.486047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:05.486486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:05.584929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b084c7e1-fb4d-4a12-8187-46e9d2ed0891 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 14 microversion: 2.1 time: 0.111364 Aug 27 04:16:05.585564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 605/1242] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:05 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:16:06.173414 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:16:06.173992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:16:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:16:06.596592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:06.597495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:06.604296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:06.604749 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:06.605533 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:06.605972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:06.698346 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-71d9b56d-5b1a-48fd-bbef-57efa666b890 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 11723 microversion: 2.1 time: 0.105800 Aug 27 04:16:06.699013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 638/1243] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:06 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 11723 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:07.710757 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:07.711778 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:07.718181 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:07.718666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:07.719437 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:07.719872 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:07.830270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f3444e77-81b6-4b99-8a56-0165bc2f77c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 18449 microversion: 2.1 time: 0.124033 Aug 27 04:16:07.830952 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 606/1244] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:07 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 18449 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:08.480980 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:08.481572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:08.488030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.494654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.494654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.494654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.514411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:16:08.843887 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:08.844784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:08.852154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.852602 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.853400 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.853836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.900830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2ceb4f2d-f6b7-4911-b96e-d026eebc5188 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 204 len: 0 microversion: 2.1 time: 0.423592 Aug 27 04:16:08.901485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 639/1245] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:16:08 2021] DELETE /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:16:08.909444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:08.910144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:08.917415 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.917868 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.918671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:08.919113 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:08.943086 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aec835ef-31cc-4cd9-88c4-e40acfe40367 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 19295 microversion: 2.1 time: 0.103356 Aug 27 04:16:08.944164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 607/1246] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:08 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 19295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:16:09.047865 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:09.056125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dd501a1b-b4e7-4498-bcc9-43fc2e2068d1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1577 microversion: 2.1 time: 0.150441 Aug 27 04:16:09.056692 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 640/1247] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:08 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:16:09.955066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:09.956051 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:09.963256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:09.963702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:09.964460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:09.964890 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.064213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1f0e4d51-ab0e-484c-abe6-2bf09da3c80c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 21282 microversion: 2.1 time: 0.113066 Aug 27 04:16:10.064919 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 608/1248] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:09 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 21282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:10.073042 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:10.073701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:10.080396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.080558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.081323 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:10.081761 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:10.206260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:10.214077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5cd4bf0a-dc7f-4ead-af75-9f32283de237 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1577 microversion: 2.1 time: 0.144700 Aug 27 04:16:10.214745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 641/1249] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:10 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1577 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:11.079371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:11.080463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:11.087866 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.088322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.089104 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.089544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.180218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1ab469c0-9158-4edc-b22e-48892a6675b0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 23130 microversion: 2.1 time: 0.107787 Aug 27 04:16:11.183989 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 609/1250] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:11 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 23130 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:11.231117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:11.231658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:11.237491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.237942 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.238735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.239203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.360463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:11.369077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d0da4a93-1138-4825-ab96-bca6a357590f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1577 microversion: 2.1 time: 0.141592 Aug 27 04:16:11.369673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 642/1251] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:11 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1577 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:11.966047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-8479e61d-6cf8-4484-aa2a-d4ad42de4fd5 req-ce176911-259f-478b-821c-8cdf12c53f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4b2954-16f9-4141-9977-dd55b199c106", "name": "network-vif-deleted", "tag": "bf689e8e-f7a7-472b-853a-879db5d6bce3"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:11.966047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:11.966047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:16:11.974080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-8479e61d-6cf8-4484-aa2a-d4ad42de4fd5 req-ce176911-259f-478b-821c-8cdf12c53f51 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:11.974080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-8479e61d-6cf8-4484-aa2a-d4ad42de4fd5 req-ce176911-259f-478b-821c-8cdf12c53f51 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:11.985235 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-8479e61d-6cf8-4484-aa2a-d4ad42de4fd5 req-ce176911-259f-478b-821c-8cdf12c53f51 service nova] Creating event network-vif-deleted:bf689e8e-f7a7-472b-853a-879db5d6bce3 for instance fc4b2954-16f9-4141-9977-dd55b199c106 on hv-cinder-80475 Aug 27 04:16:11.991880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-8479e61d-6cf8-4484-aa2a-d4ad42de4fd5 req-ce176911-259f-478b-821c-8cdf12c53f51 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034308 Aug 27 04:16:11.992727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 610/1252] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:16:12.191835 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:12.194176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:12.200532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.201118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.201978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.202531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.293751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9bbffe60-92c5-4a89-813d-9d19e42e0bd5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 24019 microversion: 2.1 time: 0.105159 Aug 27 04:16:12.297898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 643/1253] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:12 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 24019 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:12.386889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:12.387722 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:12.393974 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.404953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.404953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:12.404953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:12.458080 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:12.466956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ea32f594-be94-41a2-b282-89ac6f6754ab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 200 len: 1226 microversion: 2.1 time: 0.084114 Aug 27 04:16:12.467547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 611/1254] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:12 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:13.307086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:13.308085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:13.314655 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:13.315218 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:13.316011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:13.316452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:13.441277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7c76a2dd-428b-4e51-9ae2-8b09f63c0dae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 25696 microversion: 2.1 time: 0.139081 Aug 27 04:16:13.441956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 644/1255] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:13 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 25696 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:13.484007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:13.484546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:13.492382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:13.493652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:13.493652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:13.494066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:13.508603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] HTTP exception thrown: Instance fc4b2954-16f9-4141-9977-dd55b199c106 could not be found. Aug 27 04:16:13.509190 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Returning 404 to user: Instance fc4b2954-16f9-4141-9977-dd55b199c106 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:16:13.514132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5bb16426-6006-438e-8149-53718e54393f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 404 len: 111 microversion: 2.1 time: 0.029755 Aug 27 04:16:13.514132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 612/1256] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:13 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:16:13.606854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-783612027", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1777048250", "security_groups": [{"name": "tempest-secgroup-smoke-1607935804"}], "block_device_mapping_v2": [{"uuid": "2c1cd51f-5ddf-49c6-b7ae-42f152ddb0eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2bd2fb5-e4f2-41d4-8491-b54755281d6b"}]}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:13.720023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.network.neutron [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] validate_networks() for [('c2bd2fb5-e4f2-41d4-8491-b54755281d6b', None, None, None, None, None)] {{(pid=108986) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:16:14.178626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Flavor limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:16:14.182481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Image limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:16:14.182481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Flavor pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:16:14.182481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Image pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:16:14.182481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:16:14.191108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.191605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.192419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.193478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.210673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for project 98836f9ced7149bc904274a5add221ec. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:16:14.214686 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for user 37ca683634884d9f8af26dba5bbea16f and project 98836f9ced7149bc904274a5add221ec. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:16:14.276028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Going to run 1 instances... {{(pid=108986) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:16:14.278278 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c1cd51f-5ddf-49c6-b7ae-42f152ddb0eb',volume_size=None,volume_type=None)] {{(pid=108986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:16:14.453538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:14.454385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:14.460731 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.461176 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.461997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:14.462429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:14.555555 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6f36ff59-9517-45ef-9a70-54bacee3fa87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 27010 microversion: 2.1 time: 0.105625 Aug 27 04:16:14.556231 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 613/1257] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:14 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 27010 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:16:14.732361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-86689e0b-9de2-4ba4-bc1f-06f46fdf4a32 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.129369 Aug 27 04:16:14.732948 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 645/1258] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:16:13 2021] POST /compute/v2.1/servers => generated 406 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:16:14.743511 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0e8c2e4c-18a2-4c8c-8028-ae4d96413f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:14.750063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0e8c2e4c-18a2-4c8c-8028-ae4d96413f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:14.798541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0e8c2e4c-18a2-4c8c-8028-ae4d96413f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:14.806768 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0e8c2e4c-18a2-4c8c-8028-ae4d96413f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1094 microversion: 2.1 time: 0.067279 Aug 27 04:16:14.807350 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 614/1259] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:14 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:15.567363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:15.568925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:15.575991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:15.576448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:15.577235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:15.577677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:15.678777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c6c6b49b-448f-4eaf-910f-9a63524809be tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 27708 microversion: 2.1 time: 0.114990 Aug 27 04:16:15.679714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 646/1260] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:15 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 27708 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:15.824156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:15.824710 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:15.832842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:15.833862 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:15.834716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:15.835341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:15.893624 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:15.902077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4e0e8f79-3a5d-4d8f-bd18-eb9b9167c736 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1136 microversion: 2.1 time: 0.081765 Aug 27 04:16:15.907425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 615/1261] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:15 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1136 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:16.691234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:16.692248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:16.700884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:16.702231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:16.702231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:16.702778 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:16.795956 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-21e3c985-9531-4af0-a5b6-5fbac1ecc936 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28079 microversion: 2.1 time: 0.108200 Aug 27 04:16:16.796593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 647/1262] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:16 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28079 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:16.922450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:16.923100 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:16.931010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:16.931468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:16.932264 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:16.932703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:17.004010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:17.012945 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-49070982-3610-420e-a0bf-58fa83af8b1e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1210 microversion: 2.1 time: 0.094216 Aug 27 04:16:17.013985 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 616/1263] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:16 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:17.809581 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:17.810583 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:17.818965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:17.819561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:17.820292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:17.820923 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:17.929669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-533cf2e3-3299-4a28-810a-17070a33e620 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.124074 Aug 27 04:16:17.930359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 648/1264] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:17 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:18.030724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:18.031343 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:18.038435 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.039077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:18.040753 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.041595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:18.191877 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:18.208348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9991b3c2-d19d-4cd1-8721-73358c9cb622 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1278 microversion: 2.1 time: 0.176773 Aug 27 04:16:18.208348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 617/1265] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:18 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1278 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:18.809901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-bf6ee12f-37c4-472a-b9ef-9ac174c5a8dc req-03da8f1b-515a-476a-9228-437aa5022823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e576b6e1-2799-4b05-bbe8-c066224ac592", "tag": "f611f852-dde7-48c6-9dcf-d14f5a8b27a9"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:18.812213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:18.812213 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:16:18.824395 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-bf6ee12f-37c4-472a-b9ef-9ac174c5a8dc req-03da8f1b-515a-476a-9228-437aa5022823 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.824844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-bf6ee12f-37c4-472a-b9ef-9ac174c5a8dc req-03da8f1b-515a-476a-9228-437aa5022823 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:18.839585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-bf6ee12f-37c4-472a-b9ef-9ac174c5a8dc req-03da8f1b-515a-476a-9228-437aa5022823 service nova] Creating event network-changed:f611f852-dde7-48c6-9dcf-d14f5a8b27a9 for instance e576b6e1-2799-4b05-bbe8-c066224ac592 on hv-cinder-80475 Aug 27 04:16:18.844448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-bf6ee12f-37c4-472a-b9ef-9ac174c5a8dc req-03da8f1b-515a-476a-9228-437aa5022823 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041147 Aug 27 04:16:18.845629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 649/1266] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:16:18.941218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:18.942342 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:18.949337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.949973 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:18.950896 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:18.951432 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:19.037005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0e3b1244-93ba-4785-a055-7d31e073ccf1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.099009 Aug 27 04:16:19.037938 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 618/1267] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:18 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:19.221460 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:19.222159 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:19.229031 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:19.229484 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:19.230288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:19.230759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:19.357366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:19.365279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7fae1e04-5607-4bec-9669-790474d667eb tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.147327 Aug 27 04:16:19.366155 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 650/1268] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:19 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:20.049103 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:20.050079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:20.057508 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:20.057959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:20.058761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:20.059201 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:20.165134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2d3826b0-169f-4234-a41c-f0f1db02731d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.119797 Aug 27 04:16:20.165794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 619/1269] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:20 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:20.383259 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:20.383986 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:20.391658 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:20.392108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:20.392894 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:20.393333 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:20.519752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:20.527564 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8a6cddde-1550-40e4-b96b-a3aff76b41b1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.148860 Aug 27 04:16:20.528120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 651/1270] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:20 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:21.178367 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:21.179614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:21.186023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:21.186473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:21.187270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:21.187713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:21.271564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-29958049-6171-4a4d-b1dc-1aa691532af4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.097742 Aug 27 04:16:21.272187 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 620/1271] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:21 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:21.544558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:21.545209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:21.550960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:21.551415 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:21.553495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:21.553940 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:21.675777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:21.683342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7adfa253-e5a2-490b-af50-79f02199613a tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.142605 Aug 27 04:16:21.683903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 652/1272] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:21 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:16:22.283771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:22.284659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:22.291277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:22.291728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:22.292497 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:22.292936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:22.534514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fdafb42c-df5a-44da-baee-02532d0c043a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.254622 Aug 27 04:16:22.535142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 621/1273] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:22 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:22.700205 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:22.700792 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:22.706993 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:22.707437 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:22.708194 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:22.708641 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:22.831451 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:22.839178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3f9d8520-e7b0-4821-9691-f7bdc44e2992 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.142665 Aug 27 04:16:22.839761 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 653/1274] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:22 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:23.547346 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:23.548250 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:23.555224 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:23.555708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:23.556484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:23.556917 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:23.642923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-588d8ca9-a8bc-4577-b070-529edef53b70 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.099404 Aug 27 04:16:23.643564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 622/1275] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:23 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:23.855101 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:23.855669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:23.861531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:23.861970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:23.862799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:23.863227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:23.991147 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:23.998528 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-85115d9a-6a0c-4db4-b8f3-306b285ae67b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.147072 Aug 27 04:16:23.999117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 654/1276] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:23 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:24.656062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:24.657061 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:24.665536 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:24.665978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:24.666805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:24.667245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:24.758820 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6e2799cf-2db9-4d3e-ad81-be8eccb07fe3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.106635 Aug 27 04:16:24.759463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 623/1277] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:24 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:25.016167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:25.016852 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:25.022999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:25.023453 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:25.024249 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:25.024705 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:25.143937 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:25.151419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-78a729de-0756-4a26-8b87-543579c8c61d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.139016 Aug 27 04:16:25.151994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 655/1278] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:25 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:25.771726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:25.772735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:25.779105 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:25.779548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:25.780310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:25.780742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:25.868250 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b7996584-6644-4069-a8f6-3e661a3e2637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.101102 Aug 27 04:16:25.868893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 624/1279] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:25 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:26.168637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:26.169236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:26.175115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:26.175560 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:26.176319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:26.176851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:26.294289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:26.301747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-695596b0-8f68-4aae-90ae-2e9615505324 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.136792 Aug 27 04:16:26.302312 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 656/1280] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:26 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:26.880990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:26.881983 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:26.888460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:26.888909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:26.889684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:26.890121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:26.980647 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2395e94d-efb7-4704-8d9f-c9bf28fe2532 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.104158 Aug 27 04:16:26.981295 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 625/1281] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:26 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:16:27.321217 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:27.322635 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:27.328997 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:27.330195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:27.330195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:27.330734 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:27.454401 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:27.462319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cd8202fc-b551-40fc-8c48-9fe366194a70 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.148001 Aug 27 04:16:27.462926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 657/1282] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:27 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:27.993608 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:27.994658 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:28.001214 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.001671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.002458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.002942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.091374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f1c2cc95-44aa-42d8-9079-43fe1886cbad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.102094 Aug 27 04:16:28.092214 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 626/1283] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:27 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:16:28.479857 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:28.480462 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:28.486608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.487071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.487851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:28.488290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:28.620620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:28.627682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1f48f504-735c-40f6-9f33-296e676ade05 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.151491 Aug 27 04:16:28.628241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 658/1284] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:28 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:29.103679 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:29.104770 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:29.111270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.111720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.112492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.112928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.208429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aa93aba1-c81e-4229-bbaa-2a54c4feffab tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.108556 Aug 27 04:16:29.209071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 627/1285] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:29 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:16:29.644992 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:29.645668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:29.651711 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.652161 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.652958 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.653391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.748404 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-176ace9d-ee82-42c9-a80b-e0e354feec96 req-c0752c65-0067-4429-a903-b2327d16c219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e576b6e1-2799-4b05-bbe8-c066224ac592", "name": "network-vif-plugged", "status": "completed", "tag": "f611f852-dde7-48c6-9dcf-d14f5a8b27a9"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:29.749915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:29.749915 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:16:29.757574 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-176ace9d-ee82-42c9-a80b-e0e354feec96 req-c0752c65-0067-4429-a903-b2327d16c219 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:29.761007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-176ace9d-ee82-42c9-a80b-e0e354feec96 req-c0752c65-0067-4429-a903-b2327d16c219 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:29.769597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-176ace9d-ee82-42c9-a80b-e0e354feec96 req-c0752c65-0067-4429-a903-b2327d16c219 service nova] Creating event network-vif-plugged:f611f852-dde7-48c6-9dcf-d14f5a8b27a9 for instance e576b6e1-2799-4b05-bbe8-c066224ac592 on hv-cinder-80475 Aug 27 04:16:29.774591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-176ace9d-ee82-42c9-a80b-e0e354feec96 req-c0752c65-0067-4429-a903-b2327d16c219 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030029 Aug 27 04:16:29.775298 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 628/1286] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:16:29.778257 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:29.785626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-de099e37-f27a-4a68-bace-cb4d974a0e30 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.144871 Aug 27 04:16:29.786746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 659/1287] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:29 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:30.220873 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:30.221881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:30.228116 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.228561 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.229321 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.229749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.649868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9bd7b240-218f-4031-abed-3aa606f86362 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.432716 Aug 27 04:16:30.650435 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 629/1288] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:30 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:30.803390 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:30.803999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:30.810153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.810632 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.811415 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:30.811853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:30.933893 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:30.941140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4f13ae99-deb0-46e6-a508-00fada98de2f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.141941 Aug 27 04:16:30.941913 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 660/1289] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:30 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:31.662487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:31.663502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:31.669941 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:31.670399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:31.671218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:31.671663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:31.803065 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2f2219e5-cd92-411f-8fd5-c47a866493ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.145081 Aug 27 04:16:31.803701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 630/1290] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:31 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:31.959627 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:31.960181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:31.965950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:31.966402 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:31.967211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:31.967650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.091524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:32.099716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6ff4f134-ab24-45a1-8435-a737106dc13d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1266 microversion: 2.1 time: 0.143928 Aug 27 04:16:32.100288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 661/1291] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:31 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:32.815482 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:32.816471 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:32.824335 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:32.824789 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.825576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:32.826017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:32.936438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a3ceafcb-dea3-4cb2-8c68-824049f68227 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.124797 Aug 27 04:16:32.937128 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 631/1292] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:32 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:33.117494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:33.118118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:33.124153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.124605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.125417 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.125853 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.247388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:33.256557 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d5541b35-d6dd-4345-8f07-95b1f0ed91cd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1452 microversion: 2.1 time: 0.143791 Aug 27 04:16:33.257136 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 662/1293] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:33 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:33.272746 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:16:33.273447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:33.279883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.280337 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.281118 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.281551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.406346 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:16:33.414818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b10e4a05-add3-4181-843b-bb40e5956077 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1452 microversion: 2.1 time: 0.146123 Aug 27 04:16:33.415824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 632/1294] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:16:33 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:16:33.948761 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:33.949712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:33.955579 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.956030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:33.956796 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:33.957398 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:34.051284 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1f2e9f75-0893-41ba-9ef7-5058a3ebfe41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28195 microversion: 2.1 time: 0.105974 Aug 27 04:16:34.052691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 663/1295] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:33 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28195 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:35.064057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:35.064960 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:35.071773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:35.072218 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.072991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:35.073422 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.167341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6eac32fb-9019-4240-bb07-0016d42d999d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28486 microversion: 2.1 time: 0.106577 Aug 27 04:16:35.171174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 633/1296] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:35 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28486 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:35.756436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-117dabd8-fd79-4c42-ab50-dab4a7190805 req-79a681fe-37fe-4f16-803a-d2bd3313d731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e576b6e1-2799-4b05-bbe8-c066224ac592", "tag": "f611f852-dde7-48c6-9dcf-d14f5a8b27a9"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:35.760170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:16:35.760170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:16:35.765593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-117dabd8-fd79-4c42-ab50-dab4a7190805 req-79a681fe-37fe-4f16-803a-d2bd3313d731 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:35.766059 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-117dabd8-fd79-4c42-ab50-dab4a7190805 req-79a681fe-37fe-4f16-803a-d2bd3313d731 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:35.778119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-117dabd8-fd79-4c42-ab50-dab4a7190805 req-79a681fe-37fe-4f16-803a-d2bd3313d731 service nova] Creating event network-changed:f611f852-dde7-48c6-9dcf-d14f5a8b27a9 for instance e576b6e1-2799-4b05-bbe8-c066224ac592 on hv-cinder-80475 Aug 27 04:16:35.783054 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-117dabd8-fd79-4c42-ab50-dab4a7190805 req-79a681fe-37fe-4f16-803a-d2bd3313d731 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031047 Aug 27 04:16:35.783575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 664/1297] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:16:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:16:36.180438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:36.182379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:36.188023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:36.188670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:36.189454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:36.189894 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:36.284666 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-52371d53-b7a5-4666-92b2-83c12310f529 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.109111 Aug 27 04:16:36.285313 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 634/1298] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:36 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:37.297659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:37.298573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:37.304989 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.305436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.306209 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:37.306679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:37.390081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-86e71cdb-ab44-4279-b543-c3b5d42fd033 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096782 Aug 27 04:16:37.390747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 665/1299] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:37 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:38.402074 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:38.403089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:38.409458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:38.409908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:38.410804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:38.411526 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:38.505597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b3e492a5-4caa-4222-b958-27236e243a85 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.107419 Aug 27 04:16:38.506234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 635/1300] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:38 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:39.517098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:39.518079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:39.524730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:39.525307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:39.526075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:39.526504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:39.612696 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bd3db4c1-57bb-403b-abc8-60e273dea5ca tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.099447 Aug 27 04:16:39.613339 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 666/1301] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:39 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:40.624987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:40.625988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:40.633494 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:40.633949 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:40.634794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:40.635238 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:40.721416 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ff7da398-d555-432e-9de8-2dcdb037ae8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.100207 Aug 27 04:16:40.722063 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 636/1302] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:40 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:41.733392 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:41.738359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:41.741005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:41.741467 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:41.742229 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:41.742701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:41.838420 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d9acb41d-54e8-415c-83f6-f353cf272816 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.108859 Aug 27 04:16:41.839362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 667/1303] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:41 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:42.850800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:42.851788 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:42.858196 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:42.858677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:42.859451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:42.859883 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:42.943781 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-52335b22-f007-4fbe-843c-95546f3c6db1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096922 Aug 27 04:16:42.944462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 637/1304] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:42 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:16:43.956391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:43.957556 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:43.964590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:43.965046 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:43.965827 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:43.966274 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:44.060051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4761fea5-0ee1-4ee2-a0b9-976d4b051068 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.107442 Aug 27 04:16:44.060698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 668/1305] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:43 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:45.073015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:45.074004 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:45.081576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:45.081576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:45.082279 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:45.083023 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:45.165802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-511135d6-8f65-4457-ae70-6c832deece84 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096631 Aug 27 04:16:45.166441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 638/1306] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:45 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:46.178231 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:46.179510 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:46.185994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:46.186439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:46.187233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:46.187667 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:46.274673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-740233a7-605e-494a-89a2-f77032252af5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.100586 Aug 27 04:16:46.275313 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 669/1307] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:46 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:47.287334 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:47.288351 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:47.294544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:47.295025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:47.295811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:47.296258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:47.384760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-90c199e2-6a46-40c5-b5a7-3e92184c4414 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.101871 Aug 27 04:16:47.385462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 639/1308] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:47 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:48.397752 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:48.398677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:48.405192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:48.405639 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:48.406410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:48.406872 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:48.508028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b1f7be18-d4ba-4794-a5b3-f732b1029353 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.114903 Aug 27 04:16:48.508722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 670/1309] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:48 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:49.520345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:49.521373 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:49.527809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:49.528258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:49.529034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:49.529468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:49.622052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8fba1ee6-5b2a-44c1-b3b3-efae09737990 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.105621 Aug 27 04:16:49.623008 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 640/1310] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:49 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:50.634522 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:50.635563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:50.642081 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:50.642537 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:50.643340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:50.643777 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:50.743864 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1991504b-bcee-40c1-a065-8c1728abab79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.113373 Aug 27 04:16:50.744509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 671/1311] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:50 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:51.756875 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:51.757911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:51.764567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:51.765014 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:51.765800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:51.766241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:51.850241 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-44020500-b26f-412c-9100-005691ccc619 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.098055 Aug 27 04:16:51.850923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 641/1312] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:51 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:52.862609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:52.863785 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:52.870288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:52.870778 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:52.871543 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:52.871970 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:52.961291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-39f0a064-f64a-4f5e-ab1d-95b097bbab41 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.102499 Aug 27 04:16:52.962200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 672/1313] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:52 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:53.973794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:53.978188 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:53.982977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:53.983426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:53.984212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:53.984643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:54.069383 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-034dcbc4-1ace-4750-ba1a-3dad7674747f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.100214 Aug 27 04:16:54.070071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 642/1314] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:53 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:55.081733 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:55.083317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:55.089663 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:55.090107 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:55.090902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:55.091334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:55.173830 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9426e830-31bf-4996-95db-ab31a2f0384f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096139 Aug 27 04:16:55.174467 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 673/1315] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:55 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:56.186026 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:56.187073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:56.194142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:56.194614 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:56.195395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:56.195829 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:56.276607 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a2e9a86d-7f27-4604-8b3b-4e87533294cd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.094369 Aug 27 04:16:56.277155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 643/1316] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:56 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:57.289129 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:57.290042 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:57.296447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:57.296889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:57.297661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:57.298096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:57.380754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-00ee3133-dfaf-45bb-912e-e8c93a4dff61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.095896 Aug 27 04:16:57.381418 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 674/1317] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:57 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:58.392950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:58.393858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:58.400409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:58.400863 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:58.401639 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:58.402078 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:58.483091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b4bf1919-5fa4-4bd0-97fb-faf7457df4c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.094065 Aug 27 04:16:58.483729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 644/1318] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:58 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:16:59.495226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:16:59.496216 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:16:59.502731 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:59.503195 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:59.503969 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:16:59.504407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:16:59.589512 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-390c830a-e9d1-4e18-aa71-cfe2e0c20c17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.098187 Aug 27 04:16:59.590519 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 675/1319] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:16:59 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:00.601273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:00.602259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:00.608741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:00.609178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:00.609958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:00.610394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:00.698451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-082b799b-dadc-4f0c-ba3a-b088682f6f03 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.101039 Aug 27 04:17:00.699138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 645/1320] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:00 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:01.710582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:01.711575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:01.719067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:01.719521 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:01.720311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:01.720737 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:01.810447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f1ebd331-729f-4c4d-8f05-cb0eb1dfdc27 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.103728 Aug 27 04:17:01.811459 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 676/1321] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:01 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:02.822760 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:02.823769 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:02.830153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:02.830618 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:02.831398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:02.831845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:02.915171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f7237b24-34a2-427a-ad61-9fc37e6bb208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096295 Aug 27 04:17:02.915813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 646/1322] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:02 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:17:03.927097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:03.928083 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:03.934788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:03.935240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:03.936006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:03.936443 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:04.021327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4b83fc7b-a940-48e1-8b76-dc935d9ac4d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.098310 Aug 27 04:17:04.021980 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 677/1323] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:03 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:05.033641 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:05.034649 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:05.041134 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:05.041585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:05.042354 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:05.042828 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:05.126206 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-408cf329-e101-4b6f-8b1b-eee1ec753862 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096383 Aug 27 04:17:05.126832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 647/1324] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:05 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:06.139489 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:06.140725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:06.147422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:06.147903 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:06.148677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:06.149115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:06.230756 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cc774c6d-9848-4265-890e-0c3a9403c5de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.094992 Aug 27 04:17:06.231315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 678/1325] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:06 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:07.243506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:07.244412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:07.250903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:07.251348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:07.252111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:07.252540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:07.332111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c873d380-1e63-4e36-8dc4-f8ac34a0d293 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.093187 Aug 27 04:17:07.333371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 648/1326] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:07 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:17:08.345523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:08.346458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:08.354086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:08.354540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:08.355353 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:08.355793 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:08.442888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5ac27062-1484-408d-8b9d-c9ac9d273e75 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.101344 Aug 27 04:17:08.443662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 679/1327] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:08 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:09.455164 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:09.456153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:09.463596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:09.464047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:09.465395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:09.466174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:09.556589 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a81227cf-839f-4992-9401-cb415a5d25ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.105226 Aug 27 04:17:09.557234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 649/1328] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:09 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:10.570582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:10.571595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:10.577911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:10.578354 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:10.579158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:10.579601 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:10.661042 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-28fe6649-82e5-435d-96d7-69e8e9510522 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.094812 Aug 27 04:17:10.662097 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 680/1329] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:10 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:11.673691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:11.674697 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:11.682182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:11.682656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:11.683425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:11.683855 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:11.766805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3854391e-684a-4c9f-ae70-4fba1f7ec2df tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.096888 Aug 27 04:17:11.767445 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 650/1330] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:11 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:12.779388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:12.780411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:12.787955 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:12.788406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:12.789203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:12.789636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:12.888040 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1aba8602-f661-4724-adc0-04677b235d2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.112467 Aug 27 04:17:12.888989 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 681/1331] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:12 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:13.900947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:13.901933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:13.909467 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:13.909921 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:13.911317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:13.911756 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:13.998034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d6b7e2a4-5302-4d7e-9f70-6b3996213884 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 28654 microversion: 2.1 time: 0.100977 Aug 27 04:17:13.998703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 651/1332] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:13 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 28654 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:15.011070 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:15.012056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:15.018473 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:15.018952 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:15.020220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:15.021034 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:15.110824 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ad8e90f5-f567-49fd-a39b-bf40a5893238 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 29884 microversion: 2.1 time: 0.103750 Aug 27 04:17:15.111793 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 682/1333] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:15 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 29884 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:16.123032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:16.124056 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:16.131129 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:16.131587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:16.132375 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:16.132809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:16.223727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3aa18803-9381-4134-9b6b-3ee8191c2837 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 31865 microversion: 2.1 time: 0.104552 Aug 27 04:17:16.224360 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 652/1334] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:16 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 31865 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:17:17.235917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:17.236857 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:17.244087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:17.244536 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:17.245316 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:17.245758 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:17.334310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e13d892c-0033-4fbe-99ff-4e1ee3c261fc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 33389 microversion: 2.1 time: 0.102307 Aug 27 04:17:17.335022 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 683/1335] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:17 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 33389 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:18.346650 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:18.347584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:18.353935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:18.354386 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:18.355182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:18.355619 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:18.456643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-76c1eebc-e57f-424c-94e4-1f50f34a1a94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 34462 microversion: 2.1 time: 0.113993 Aug 27 04:17:18.457928 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 653/1336] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:18 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 34462 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:19.470163 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:19.471203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:19.478517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:19.479023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:19.479796 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:19.480236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:19.581825 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-88aac828-3ce1-46f6-991c-23e3afd9e45c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 35655 microversion: 2.1 time: 0.115209 Aug 27 04:17:19.583531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 684/1337] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:19 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 35655 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:20.595456 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:20.596453 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:20.603994 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:20.604440 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:20.605217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:20.605653 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:20.707401 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-675b03a9-5d41-4126-b7bb-c111807fbfb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 37177 microversion: 2.1 time: 0.115619 Aug 27 04:17:20.708319 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 654/1338] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:20 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 37177 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:21.719389 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:21.720380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:21.727988 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:21.728438 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:21.729247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:21.729683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:21.818362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b6a4d873-a895-44be-9f72-d3d6bf5c4911 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 38188 microversion: 2.1 time: 0.102841 Aug 27 04:17:21.819897 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 685/1339] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:21 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 38188 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:22.831289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:22.832459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:22.839235 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:22.839688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:22.840466 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:22.840902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:22.934816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1be01a89-9166-4a65-b58f-db277a89eb53 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 38188 microversion: 2.1 time: 0.107304 Aug 27 04:17:22.935446 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 655/1340] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:22 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 38188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:23.947800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:23.948801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:23.955576 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:23.956033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:23.956856 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:23.957715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:24.041176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-43ce2aa2-97f1-447c-afb8-7fa8994db2c7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 38188 microversion: 2.1 time: 0.097283 Aug 27 04:17:24.042169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 686/1341] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:23 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 38188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:25.053485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:25.054758 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:25.061093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:25.061549 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:25.062306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:25.062771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:25.151708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-30c96a52-ea65-4beb-8123-c77929d38b17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 38188 microversion: 2.1 time: 0.102061 Aug 27 04:17:25.152338 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 656/1342] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:25 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 38188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:26.164820 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:26.165814 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:26.172329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:26.172786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:26.173563 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:26.174000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:26.266007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0a628118-af55-453c-9057-bacb89a76c8d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 200 len: 38319 microversion: 2.1 time: 0.105812 Aug 27 04:17:26.266673 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 687/1343] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:26 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 38319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:17:26.277567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:26.278146 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:26.284567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:26.285735 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:26.286680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:26.287119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:26.313034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-715b2487-a13d-4e81-bb04-95b45af81b8c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/ips" status: 200 len: 145 microversion: 2.1 time: 0.039424 Aug 27 04:17:26.313593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 657/1344] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Aug 27 04:17:26 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:17:30.102019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f991982d-ebdb-4918-94d3-13a5485dd457"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:30.103187 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:30.109654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:30.110109 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:30.110917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:30.111355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:30.771807 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-988312df-b160-4d2c-9da1-9d9bca36dae7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.673848 Aug 27 04:17:30.772408 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 688/1345] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:17:30 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-volume_attachments => generated 194 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:17:39.354640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-392aac62-95c2-4382-ae0e-0a41aa050b87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:39.360967 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-392aac62-95c2-4382-ae0e-0a41aa050b87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:39.361417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-392aac62-95c2-4382-ae0e-0a41aa050b87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:39.421553 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-392aac62-95c2-4382-ae0e-0a41aa050b87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Going to try to stop instance {{(pid=108985) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 04:17:39.610035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-392aac62-95c2-4382-ae0e-0a41aa050b87 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.258583 Aug 27 04:17:39.610542 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 658/1346] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:39 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:17:39.619230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:39.619925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:39.626744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:39.627201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:39.627966 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:39.628786 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:39.906960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:39.917839 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d1ec37ce-11ee-4200-9f29-75084d5b67e0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.302772 Aug 27 04:17:39.918406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 689/1347] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:39 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:40.934676 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:40.935365 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:40.941251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:40.941694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:40.942460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:40.943547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:41.066382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:41.074144 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f8338803-bdc5-4af9-ab6d-16f3407a7a50 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.143527 Aug 27 04:17:41.074732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 659/1348] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:40 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:42.091255 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:42.091788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:42.098298 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:42.098900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:42.099707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:42.100140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:42.222080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:42.230036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d105ba26-1d8a-4d11-8da5-3911ff0e77c0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.142687 Aug 27 04:17:42.230608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 690/1349] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:42 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:43.247327 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:43.248010 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:43.254246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:43.254730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:43.256215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:43.256652 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:43.379486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:43.387709 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d5ca942e-ccde-4881-9d8f-2d4033c442fa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.144020 Aug 27 04:17:43.388417 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 660/1350] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:43 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:44.405446 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:44.406061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:44.412640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:44.413091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:44.413876 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:44.414315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:44.534359 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:44.543319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c0ab3e80-6926-4e0a-82aa-06e6afda1ad6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.141562 Aug 27 04:17:44.543878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 691/1351] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:44 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:45.560752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:45.561296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:45.567189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:45.568515 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:45.569282 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:45.569716 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:45.687543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:45.695718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-48a0219f-c71d-4387-939f-daea97fc77d3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.138749 Aug 27 04:17:45.696270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 661/1352] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:45 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:46.713480 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:46.714093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:46.720432 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:46.720891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:46.721690 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:46.722128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:46.851146 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:46.858898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-367fc0f2-8ab5-416d-b26e-b9934908d783 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.149118 Aug 27 04:17:46.859458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 692/1353] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:46 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:47.876348 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:47.876959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:47.883845 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:47.884304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:47.885074 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:47.885508 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:48.002452 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:48.011379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9cec112a-38c5-44b7-a462-abd7d39bee2d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.138649 Aug 27 04:17:48.011947 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 662/1354] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:47 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:49.028750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:49.029362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:49.035251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:49.035698 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:49.037267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:49.037700 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:49.163897 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:49.171700 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2c6fa4ee-bba3-495c-ac78-c022813c5371 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.146657 Aug 27 04:17:49.172257 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 693/1355] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:49 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:50.189008 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:50.189625 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:50.195995 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:50.196441 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:50.197204 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:50.197636 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:50.319528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:50.327142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3bd8ac9f-ca3b-42b4-925e-0cf16c2cac05 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.141760 Aug 27 04:17:50.327703 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 663/1356] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:50 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:51.345133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:51.345689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:51.351789 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:51.352235 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:51.352995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:51.353427 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:51.484012 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:51.490746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d9794b7e-2a4c-44e8-bf8d-d8a8fd39c672 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.149227 Aug 27 04:17:51.491292 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 694/1357] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:51 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:52.508148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:52.508786 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:52.514698 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:52.515148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:52.515913 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:52.516353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:52.636353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:52.644049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c880ea1e-556e-4e90-b94a-0e9338fd1430 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.140092 Aug 27 04:17:52.644617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 664/1358] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:52 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:53.662508 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:53.663139 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:53.668967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:53.669418 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:53.670186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:53.670656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:53.793781 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:53.801452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0893bb66-4636-4fa8-9eaa-e35d4f707ec5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.143487 Aug 27 04:17:53.802009 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 695/1359] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:53 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:54.819277 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:54.819868 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:54.825711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:54.826155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:54.826946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:54.827377 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:54.948021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:54.956391 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2470b72c-bc28-438a-91d6-24c543bd0c6a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1723 microversion: 2.1 time: 0.140875 Aug 27 04:17:54.956965 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 665/1360] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:54 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:55.974049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:55.974670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:55.981142 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:55.981579 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:55.982352 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:55.982817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:56.102180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:56.109886 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-22c2e738-ec3d-426c-b9fb-1530bd1691de tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1700 microversion: 2.1 time: 0.139936 Aug 27 04:17:56.110447 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 696/1361] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:55 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1700 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:56.126996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-bfc2463c-4a76-4a60-b0e6-2e0aa531356a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:17:56.133400 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bfc2463c-4a76-4a60-b0e6-2e0aa531356a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:56.133858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-bfc2463c-4a76-4a60-b0e6-2e0aa531356a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:56.155059 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-bfc2463c-4a76-4a60-b0e6-2e0aa531356a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Going to try to start instance {{(pid=108985) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 04:17:56.346400 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-bfc2463c-4a76-4a60-b0e6-2e0aa531356a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.222847 Aug 27 04:17:56.346969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 666/1362] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:17:56 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:17:56.355368 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:56.357582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:56.362707 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:56.363160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:56.364647 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:56.365091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:56.491211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:56.500751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-37eda9cd-a967-4f3b-933c-b49d359c0c20 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1709 microversion: 2.1 time: 0.148975 Aug 27 04:17:56.501310 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 697/1363] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:56 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:57.519162 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:57.519766 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:57.526485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:57.526963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:57.527730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:57.528158 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:57.648087 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:57.655696 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-25e8bee4-5ae7-460c-b47b-27536012b950 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1709 microversion: 2.1 time: 0.140665 Aug 27 04:17:57.656260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 667/1364] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:57 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1709 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:17:58.672843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:17:58.673448 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:17:58.679834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:58.680268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:58.681043 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:17:58.681488 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:17:58.800916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:17:58.809536 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a34772ca-e96c-4613-8aa8-fb997afc2adf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1713 microversion: 2.1 time: 0.140431 Aug 27 04:17:58.810096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 698/1365] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:17:58 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1713 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:18:02.724503 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:18:02.725115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:18:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:18:19.198246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:18:19.199020 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:18:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:18:28.067591 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:18:28.068191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:18:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:19:05.652856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1217955907", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1777048250", "security_groups": [{"name": "tempest-secgroup-smoke-1607935804"}], "block_device_mapping_v2": [{"uuid": "2b73214c-2110-48ab-ad17-01e3ca684b9d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2bd2fb5-e4f2-41d4-8491-b54755281d6b"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:05.855748 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] validate_networks() for [('c2bd2fb5-e4f2-41d4-8491-b54755281d6b', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:19:06.005527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:06.006032 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:06.012167 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:06.012623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:06.013493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:06.013873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:06.151516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lazy-loading 'services' on Instance uuid 45894587-8bff-45cc-ab9f-b8ec963e6ae5 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:19:06.309878 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:19:06.310309 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:19:06.312329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:19:06.312329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:19:06.312329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:19:06.321674 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:06.322126 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:06.323006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:06.323541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:06.340727 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for project 98836f9ced7149bc904274a5add221ec. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:19:06.344664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Getting quotas for user 37ca683634884d9f8af26dba5bbea16f and project 98836f9ced7149bc904274a5add221ec. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:19:06.370496 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-189a356e-8997-45f0-a8cd-6e0bd276f768 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-volume_attachments/f991982d-ebdb-4918-94d3-13a5485dd457" status: 202 len: 0 microversion: 2.1 time: 0.370362 Aug 27 04:19:06.371121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 699/1366] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:19:05 2021] DELETE /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-volume_attachments/f991982d-ebdb-4918-94d3-13a5485dd457 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:19:06.411049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:19:06.413635 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2b73214c-2110-48ab-ad17-01e3ca684b9d',volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:19:06.837163 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-15ba9e83-3d5f-4908-8a14-7ef738138b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.188797 Aug 27 04:19:06.837834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 668/1367] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:19:05 2021] POST /compute/v2.1/servers => generated 406 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:19:06.849388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-95aab9a9-6bc5-4a15-ac5d-e24c5870be37 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:06.850090 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-95aab9a9-6bc5-4a15-ac5d-e24c5870be37 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:06.907069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-95aab9a9-6bc5-4a15-ac5d-e24c5870be37 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:06.914972 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-95aab9a9-6bc5-4a15-ac5d-e24c5870be37 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1095 microversion: 2.1 time: 0.070730 Aug 27 04:19:06.915740 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 700/1368] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:06 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:07.932592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-09bfb18e-8a3a-4723-86d9-61a25c6b5f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:07.933210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-09bfb18e-8a3a-4723-86d9-61a25c6b5f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:07.996306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-09bfb18e-8a3a-4723-86d9-61a25c6b5f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:08.003765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-09bfb18e-8a3a-4723-86d9-61a25c6b5f63 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1095 microversion: 2.1 time: 0.075431 Aug 27 04:19:08.004824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 669/1369] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:07 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1095 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:08.555283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3ddcf478-d506-4c9b-94d4-2c34c18f1303 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:08.561717 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3ddcf478-d506-4c9b-94d4-2c34c18f1303 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:08.562188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-3ddcf478-d506-4c9b-94d4-2c34c18f1303 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:08.625181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3ddcf478-d506-4c9b-94d4-2c34c18f1303 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Going to try to stop instance {{(pid=108986) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 27 04:19:08.854270 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3ddcf478-d506-4c9b-94d4-2c34c18f1303 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.302806 Aug 27 04:19:08.855027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 701/1370] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:19:08 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:19:08.863502 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:08.864150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:08.869946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:08.870391 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:08.871189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:08.871669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:08.996912 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:09.005047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-932764d9-364e-48fd-95c8-80faa97c00db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.145388 Aug 27 04:19:09.005609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 670/1371] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:08 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:09.022302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:09.023033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:09.029548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:09.030516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:09.030924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:09.031540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:09.091302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:09.100033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ec59996e-1e64-486e-b502-5ab473c1168d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1137 microversion: 2.1 time: 0.082044 Aug 27 04:19:09.100599 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 702/1372] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:09 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:10.023122 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:10.024333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:10.031012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:10.031677 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:10.033008 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:10.033442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:10.117119 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:10.117771 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:10.123862 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:10.124608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:10.125499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:10.126753 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:10.167458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:10.175590 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5c47e274-8d86-4652-9488-c6dee4b98577 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.156222 Aug 27 04:19:10.176168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 671/1373] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:10 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:10.198039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:10.206212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cdaaf74f-8f7c-44ef-890a-b20a1a5c56d7 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1211 microversion: 2.1 time: 0.092767 Aug 27 04:19:10.206838 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 703/1374] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:10 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:11.192849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:11.193465 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:11.199352 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:11.199817 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:11.200596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:11.201040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:11.223427 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:11.224128 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:11.230251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:11.230744 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:11.231571 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:11.232123 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:11.383637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:11.389054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9e1ca271-d355-4815-a00d-b344cdb06d69 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.199779 Aug 27 04:19:11.389634 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 672/1375] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:11 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:11.409493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:11.420879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-83f1aa97-4746-4f47-b949-812fc3d00b95 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1279 microversion: 2.1 time: 0.198436 Aug 27 04:19:11.420879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 704/1376] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:11 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1279 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:11.607000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-75fab8f9-444a-4509-b126-5408aa34d535 req-3f914e63-4cc9-45ed-8dbe-5389fd3e74f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db3235e-3d16-49bd-81b7-d66f8a7b869c", "tag": "0ec77322-46d4-445f-9d96-1b0364722727"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:11.609032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:19:11.609032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:19:11.617292 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-75fab8f9-444a-4509-b126-5408aa34d535 req-3f914e63-4cc9-45ed-8dbe-5389fd3e74f9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:11.617765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-75fab8f9-444a-4509-b126-5408aa34d535 req-3f914e63-4cc9-45ed-8dbe-5389fd3e74f9 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:11.629749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-75fab8f9-444a-4509-b126-5408aa34d535 req-3f914e63-4cc9-45ed-8dbe-5389fd3e74f9 service nova] Creating event network-changed:0ec77322-46d4-445f-9d96-1b0364722727 for instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c on hv-cinder-80475 Aug 27 04:19:11.635228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-75fab8f9-444a-4509-b126-5408aa34d535 req-3f914e63-4cc9-45ed-8dbe-5389fd3e74f9 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033439 Aug 27 04:19:11.636008 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 673/1377] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:19:12.406149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:12.406799 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:12.412679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:12.413185 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:12.413905 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:12.414335 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:12.436778 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:12.437558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:12.444549 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:12.444998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:12.445782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:12.446211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:12.604241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:12.608813 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:12.612158 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-490b73e2-6675-418f-9b60-a7f0c5d6b55c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.209651 Aug 27 04:19:12.612818 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 705/1378] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:12 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:12.616802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-95c8f27b-0cbd-4226-867e-3e8c2ba94cab tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.184101 Aug 27 04:19:12.617360 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 674/1379] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:12 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:13.628976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:13.629532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:13.633220 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:13.633948 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:13.637572 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:13.638153 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:13.639188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:13.639759 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:13.640005 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:13.640450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:13.641211 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:13.641695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:13.829323 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:13.833943 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:13.836480 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2480d995-4760-4aa1-93e4-94cd034b2551 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.207077 Aug 27 04:19:13.837054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 675/1380] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:13 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:13.841511 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-61e2106a-e95a-4b5e-854a-01b100f7f83a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.216232 Aug 27 04:19:13.842172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 706/1381] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:13 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:14.852902 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:14.853452 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:14.858156 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:14.858839 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:14.859409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:14.859857 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:14.860656 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:14.861346 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:14.864670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:14.865133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:14.865922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:14.866364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:15.044048 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:15.046429 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:15.051502 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ae044e40-17ca-44b4-8f9f-ac0798399f0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.196872 Aug 27 04:19:15.052079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 707/1382] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:14 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:15.054935 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-25833d08-28ee-4c89-86e0-3104029216ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.205665 Aug 27 04:19:15.055512 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 676/1383] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:14 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:16.069670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:16.070291 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:16.071858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:16.072483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:16.076485 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:16.076938 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:16.077715 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:16.078151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:16.078310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:16.078794 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:16.079956 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:16.080587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:16.252058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:16.256529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:16.259730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f7248b68-e054-4eeb-9afa-696a90aa8feb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.193805 Aug 27 04:19:16.260512 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 708/1384] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:16 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:16.263979 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-94a0fe68-e35b-499d-a829-e31038f975a3 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.195661 Aug 27 04:19:16.264624 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 677/1385] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:16 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:17.276976 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:17.277596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:17.280649 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:17.281271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:17.283872 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:17.284334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:17.285129 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:17.285664 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:17.288043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:17.288524 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:17.289333 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:17.289767 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:17.464746 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:17.469225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:17.473056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aeea8e87-03e4-4937-b24b-e9271bc805e5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.199693 Aug 27 04:19:17.473632 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 709/1386] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:17 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:17.476591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5482a4f1-2140-4719-8c5b-d134c3e4ffc1 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.199904 Aug 27 04:19:17.477158 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 678/1387] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:17 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:18.490704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:18.491326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:18.492836 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:18.493576 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:18.497547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:18.498004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:18.498807 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:18.499242 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:18.499373 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:18.499690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:18.500462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:18.501776 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:18.678590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:18.685663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:18.686376 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0733e930-434b-46d6-ac37-9c574dc3a416 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1677 microversion: 2.1 time: 0.200084 Aug 27 04:19:18.686983 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 710/1388] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:18 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1677 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:18.693509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b192b2dc-6b13-469c-885d-71a1b0c788b9 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.204303 Aug 27 04:19:18.694057 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 679/1389] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:18 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:19.705176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:19.706154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:19.712038 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:19.716360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:19.716360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:19.716587 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:19.717370 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:19.717544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:19.721785 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:19.722606 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:19.724088 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:19.724588 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:19.954979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:19.962287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:19.963499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7c70e0e2-a4f8-4c69-a6f6-666a931ca8e7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1654 microversion: 2.1 time: 0.263576 Aug 27 04:19:19.964290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 711/1390] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:19 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1654 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:19.969932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2ccdfc6d-ea5d-43f3-b40e-4a76aa289a0e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.262089 Aug 27 04:19:19.970538 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 680/1391] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:19 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:19.983751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1194c1eb-714f-4d12-8c5e-5501eae9c322 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:19.990607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1194c1eb-714f-4d12-8c5e-5501eae9c322 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:19.991072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1194c1eb-714f-4d12-8c5e-5501eae9c322 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:20.017854 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1194c1eb-714f-4d12-8c5e-5501eae9c322 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Going to try to start instance {{(pid=108986) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 27 04:19:20.203047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1194c1eb-714f-4d12-8c5e-5501eae9c322 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action" status: 202 len: 0 microversion: 2.1 time: 0.224597 Aug 27 04:19:20.203672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 712/1392] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:19:19 2021] POST /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:19:20.214431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:20.214431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:20.220044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:20.225254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:20.225254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:20.225254 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:20.361271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:20.369724 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cc4d7048-5706-43cc-8266-a0e6d5a82a28 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1663 microversion: 2.1 time: 0.160846 Aug 27 04:19:20.370279 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 681/1393] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:20 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1663 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:20.989127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:20.989815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:20.996079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:20.996545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:20.997309 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:20.997738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:21.117071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:21.124133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f8482358-1f15-4acd-9319-01ec4f33ab66 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.139663 Aug 27 04:19:21.124683 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 713/1394] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:20 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:21.391839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:21.392517 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:21.398802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:21.399262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:21.400044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:21.400485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:21.534112 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:21.541763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a5f05860-3a66-496e-8043-1c97f679f0a4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1663 microversion: 2.1 time: 0.154251 Aug 27 04:19:21.542339 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 682/1395] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:21 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1663 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:22.140872 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:22.141575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:22.147938 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:22.148391 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:22.149174 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:22.149611 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:22.272072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:22.279521 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-92e44198-2db0-4d42-8338-c4059e8e9977 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.142268 Aug 27 04:19:22.280084 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 714/1396] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:22 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:22.559885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:22.560689 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:22.568267 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:22.568720 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:22.569505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:22.569937 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:22.694392 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:22.701775 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0ed9f43e-1926-4c53-9227-bcf976c801a9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1667 microversion: 2.1 time: 0.145638 Aug 27 04:19:22.702345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 683/1397] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:22 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1667 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:19:23.296192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:23.296804 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:23.303500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:23.303958 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:23.304999 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:23.305442 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:23.436914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:23.444997 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b6de57b5-e433-4bba-9493-8c7172bff62c tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.152428 Aug 27 04:19:23.445555 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 715/1398] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:23 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:24.463393 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:24.464206 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:24.470210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:24.470909 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:24.475748 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:24.475748 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:24.597802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:24.602670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-dac8ff1a-6b10-4fa9-8a80-d06ca5e69002 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.142943 Aug 27 04:19:24.603262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 684/1399] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:24 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:24.642769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-17e8f523-e533-4cd8-a143-5c662afc23d3 req-d271d847-1c3d-4690-8adf-17011d3fc899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db3235e-3d16-49bd-81b7-d66f8a7b869c", "name": "network-vif-plugged", "status": "completed", "tag": "0ec77322-46d4-445f-9d96-1b0364722727"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:24.644360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:19:24.644360 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:19:24.651215 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-17e8f523-e533-4cd8-a143-5c662afc23d3 req-d271d847-1c3d-4690-8adf-17011d3fc899 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:24.651667 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-17e8f523-e533-4cd8-a143-5c662afc23d3 req-d271d847-1c3d-4690-8adf-17011d3fc899 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:24.663415 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-17e8f523-e533-4cd8-a143-5c662afc23d3 req-d271d847-1c3d-4690-8adf-17011d3fc899 service nova] Creating event network-vif-plugged:0ec77322-46d4-445f-9d96-1b0364722727 for instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c on hv-cinder-80475 Aug 27 04:19:24.668303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-17e8f523-e533-4cd8-a143-5c662afc23d3 req-d271d847-1c3d-4690-8adf-17011d3fc899 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086232 Aug 27 04:19:24.668873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 716/1400] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:19:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:19:25.620799 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:25.621372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:25.627693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:25.628141 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:25.628911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:25.629347 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:25.748544 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:25.757117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-11d81d6d-cdba-4481-9b83-36eb4504574e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.140105 Aug 27 04:19:25.757906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 685/1401] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:25 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:26.192166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:19:26.192776 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:19:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:19:26.774105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:26.774833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:26.781201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:26.782325 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:26.783724 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:26.784172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:26.911127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:26.918710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b79a6042-17ea-4117-898c-24c565067a75 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1267 microversion: 2.1 time: 0.148564 Aug 27 04:19:26.919266 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 717/1402] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:26 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:27.935842 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:27.936582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:27.943458 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:27.943916 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:27.944721 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:27.945153 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:28.077062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:28.086045 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-17d9eb72-234a-4f81-9c87-f4ae5cde7085 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1452 microversion: 2.1 time: 0.153903 Aug 27 04:19:28.086640 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 686/1403] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:27 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:28.102774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:19:28.103558 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:19:28.109410 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:28.109934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:28.110874 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:28.111394 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:28.237488 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:19:28.245035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-45bbe301-21d8-46ab-a4b5-2042bcb34741 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1452 microversion: 2.1 time: 0.145944 Aug 27 04:19:28.245598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 718/1404] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:19:28 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:19:30.706991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-dc132e05-dbba-4e47-b136-7dc8ec8e0ee2 req-9040091e-35fa-4d52-a924-8d523a1891aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db3235e-3d16-49bd-81b7-d66f8a7b869c", "tag": "0ec77322-46d4-445f-9d96-1b0364722727"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:19:30.708619 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:19:30.708619 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:19:30.715580 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-dc132e05-dbba-4e47-b136-7dc8ec8e0ee2 req-9040091e-35fa-4d52-a924-8d523a1891aa service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:19:30.716030 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-dc132e05-dbba-4e47-b136-7dc8ec8e0ee2 req-9040091e-35fa-4d52-a924-8d523a1891aa service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:19:30.727826 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-dc132e05-dbba-4e47-b136-7dc8ec8e0ee2 req-9040091e-35fa-4d52-a924-8d523a1891aa service nova] Creating event network-changed:0ec77322-46d4-445f-9d96-1b0364722727 for instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c on hv-cinder-80475 Aug 27 04:19:30.733906 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-dc132e05-dbba-4e47-b136-7dc8ec8e0ee2 req-9040091e-35fa-4d52-a924-8d523a1891aa service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108998 Aug 27 04:19:30.734514 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 687/1405] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:39.556793 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d549f506-4416-46b2-8a80-d941453b9595] AMQP server on 10.222.0.73:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 27 04:20:39.560318 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:39.561290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:39.567258 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:39.567712 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:39.568481 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:39.568917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:39.597592 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e418129e-c2a3-49dd-b53e-42317cdd829e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043008 Aug 27 04:20:39.598131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 719/1406] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:20:39 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:20:39.656768 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05368f9e-b724-4253-88eb-17bdbbcdc98a] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:20:39.660743 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:39.661322 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:39.668317 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:39.668761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:39.669522 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:39.669950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:39.693663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:20:39.945898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f394e589-9f1c-403f-a68e-3e69a75f63ae tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 204 len: 0 microversion: 2.1 time: 0.290601 Aug 27 04:20:39.946519 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 688/1407] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:20:39 2021] DELETE /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:20:39.954889 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:39.955490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:39.961212 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:39.961652 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:39.962413 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:39.962873 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:40.082843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:40.091304 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a8202caf-d9e4-40ed-b702-1df0a1d472c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1673 microversion: 2.1 time: 0.139986 Aug 27 04:20:40.091868 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 720/1408] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:39 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1673 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:41.108993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:41.109688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:41.126653 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:41.127106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:41.127889 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:41.128330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:41.144240 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] [05368f9e-b724-4253-88eb-17bdbbcdc98a] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41490. Aug 27 04:20:41.253944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:41.261702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-90f1f888-cdc7-4110-904d-e6d81b00c4ec tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1673 microversion: 2.1 time: 0.156807 Aug 27 04:20:41.262266 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 689/1409] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:41 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:42.278079 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:42.278714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:42.297136 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:42.297596 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:42.298429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:42.299016 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:42.304518 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] [d549f506-4416-46b2-8a80-d941453b9595] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 41496. Aug 27 04:20:42.421077 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:42.428230 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-87ce17c3-a94d-4732-acb8-2498e1fc1e5a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1673 microversion: 2.1 time: 0.153901 Aug 27 04:20:42.428780 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 721/1410] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:42 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:43.446605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:43.449814 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:43.455038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-653dedae-9090-41ea-b7cd-6e6e357a5990 req-8e947e7f-9357-4712-b345-f7ec95bcc3c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45894587-8bff-45cc-ab9f-b8ec963e6ae5", "name": "network-vif-deleted", "tag": "3fce287d-dfc5-4a0d-8882-b3e2a759aef8"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:43.456141 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:43.456607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:43.456761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:20:43.456761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:20:43.457514 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:43.458210 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:43.467585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-653dedae-9090-41ea-b7cd-6e6e357a5990 req-8e947e7f-9357-4712-b345-f7ec95bcc3c3 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:43.467585 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-653dedae-9090-41ea-b7cd-6e6e357a5990 req-8e947e7f-9357-4712-b345-f7ec95bcc3c3 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:43.484568 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-653dedae-9090-41ea-b7cd-6e6e357a5990 req-8e947e7f-9357-4712-b345-f7ec95bcc3c3 service nova] Creating event network-vif-deleted:3fce287d-dfc5-4a0d-8882-b3e2a759aef8 for instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 on hv-cinder-80475 Aug 27 04:20:43.491025 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-653dedae-9090-41ea-b7cd-6e6e357a5990 req-8e947e7f-9357-4712-b345-f7ec95bcc3c3 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096985 Aug 27 04:20:43.492303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 690/1411] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:20:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:43.539076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:43.549021 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-edfac256-c13e-447c-8372-09532dbacf54 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 200 len: 1605 microversion: 2.1 time: 0.107467 Aug 27 04:20:43.549878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 722/1412] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:43 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 1605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:20:44.567412 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:44.568100 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:44.574638 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:44.575084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:44.575849 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:44.576281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:44.590071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] HTTP exception thrown: Instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 could not be found. Aug 27 04:20:44.590714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Returning 404 to user: Instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:20:44.591527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3b56e15f-f5b4-48e6-ba8f-13a627f0eecb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 404 len: 111 microversion: 2.1 time: 0.028323 Aug 27 04:20:44.592058 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 691/1413] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:44 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:20:44.600674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2e16eee9-2cc6-4782-828b-057622499dcb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '.version_select at 0x7f538e634b80>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:44.649364 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2e16eee9-2cc6-4782-828b-057622499dcb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866413771" status: 202 len: 0 microversion: 2.1 time: 0.052309 Aug 27 04:20:44.649920 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 723/1414] 10.222.0.73 () {58 vars in 1218 bytes} [Fri Aug 27 04:20:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866413771 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:20:45.417575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e17b2c07-01a3-408d-96ba-005c7c9e37c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: .version_select at 0x7f539329f4c0>, body: {"keypair": {"name": "tempest-keypair-692100304"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:45.444900 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-e17b2c07-01a3-408d-96ba-005c7c9e37c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:20:45.448613 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-e17b2c07-01a3-408d-96ba-005c7c9e37c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for user 1eee45d5e088466d8ebf58a9755ea45d and project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:20:45.664659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-e17b2c07-01a3-408d-96ba-005c7c9e37c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:20:45.670017 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-e17b2c07-01a3-408d-96ba-005c7c9e37c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for user 1eee45d5e088466d8ebf58a9755ea45d and project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'key_pairs'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:20:45.683397 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e17b2c07-01a3-408d-96ba-005c7c9e37c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.269508 Aug 27 04:20:45.684002 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 692/1415] 10.222.0.73 () {60 vars in 1158 bytes} [Fri Aug 27 04:20:45 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:20:47.855117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1076007841", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "70ebb7eb-7166-412b-a492-12027e1cc0b5"}], "security_groups": [{"name": "tempest-securitygroup--566347037"}], "key_name": "tempest-keypair-692100304", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:47.952624 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.network.neutron [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] validate_networks() for [('70ebb7eb-7166-412b-a492-12027e1cc0b5', None, None, None, None, None)] {{(pid=108986) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:20:48.320593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Flavor limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:20:48.321015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Image limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:20:48.321486 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Flavor pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:20:48.321890 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Image pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:20:48.322297 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:20:48.330860 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:48.331300 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:48.332091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:48.332516 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:48.348582 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:20:48.352378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Getting quotas for user 1eee45d5e088466d8ebf58a9755ea45d and project 0e215cb584e04408bc95d37a5c81d1de. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:20:48.363595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Going to run 1 instances... {{(pid=108986) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:20:48.365857 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:20:48.439818 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ec520111-38c3-4eb0-bd83-5dc7a9f093f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.588602 Aug 27 04:20:48.440458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 724/1416] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:20:47 2021] POST /compute/v2.1/servers => generated 401 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:20:48.450059 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-02398027-94fc-4ed4-9fb8-7386a5e9a807 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:48.450699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-02398027-94fc-4ed4-9fb8-7386a5e9a807 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:48.508683 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-02398027-94fc-4ed4-9fb8-7386a5e9a807 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:48.516907 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-02398027-94fc-4ed4-9fb8-7386a5e9a807 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1237 microversion: 2.1 time: 0.070554 Aug 27 04:20:48.517475 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 693/1417] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:48 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:49.533591 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-3bff8d2c-0c5d-4fc1-b146-2a95182eff73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:49.534220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-3bff8d2c-0c5d-4fc1-b146-2a95182eff73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:49.589719 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-3bff8d2c-0c5d-4fc1-b146-2a95182eff73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:49.596605 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-3bff8d2c-0c5d-4fc1-b146-2a95182eff73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1237 microversion: 2.1 time: 0.066943 Aug 27 04:20:49.597154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 725/1418] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:49 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:50.613305 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3d355b33-b30c-443b-88dc-b11ae25c325b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:50.613922 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3d355b33-b30c-443b-88dc-b11ae25c325b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:50.664046 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-3d355b33-b30c-443b-88dc-b11ae25c325b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:50.670329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3d355b33-b30c-443b-88dc-b11ae25c325b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1237 microversion: 2.1 time: 0.060756 Aug 27 04:20:50.671400 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 694/1419] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:50 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1237 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:51.687541 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:51.688248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:51.693973 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:51.694422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:51.695225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:51.695662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:51.754399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:51.761498 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-c4f66b2e-64ce-4222-8ffd-0a76f40ca062 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1289 microversion: 2.1 time: 0.077837 Aug 27 04:20:51.762051 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 726/1420] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:51 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1289 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:52.778988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:52.779600 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:52.786486 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:52.790690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:52.790690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:52.790690 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:52.935189 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:52.943034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a261c1af-e207-43db-8126-8bf47a5f671a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.167478 Aug 27 04:20:52.943616 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 695/1421] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:52 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:53.738374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-aadd3b1c-504f-43de-8e97-cba486ae209f req-e6a767b0-0bad-4c00-9bd8-0117479200d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28eee340-e8f2-4dfe-842a-05ddfc1eb40d", "tag": "7c6a20ee-51f2-41d8-92d2-c879bdd48024"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:20:53.740243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:20:53.740243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:20:53.749228 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-aadd3b1c-504f-43de-8e97-cba486ae209f req-e6a767b0-0bad-4c00-9bd8-0117479200d0 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:53.749668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-aadd3b1c-504f-43de-8e97-cba486ae209f req-e6a767b0-0bad-4c00-9bd8-0117479200d0 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:53.761995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-aadd3b1c-504f-43de-8e97-cba486ae209f req-e6a767b0-0bad-4c00-9bd8-0117479200d0 service nova] Creating event network-changed:7c6a20ee-51f2-41d8-92d2-c879bdd48024 for instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d on hv-cinder-80475 Aug 27 04:20:53.767652 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-aadd3b1c-504f-43de-8e97-cba486ae209f req-e6a767b0-0bad-4c00-9bd8-0117479200d0 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032703 Aug 27 04:20:53.768468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 727/1422] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:20:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:20:53.959881 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:53.960421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:53.966316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:53.966809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:53.967599 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:53.968038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:54.092316 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:54.099911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e6e2eda9-8e71-4e15-a2ba-f89ff0ceec1c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.143810 Aug 27 04:20:54.100473 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 696/1423] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:53 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:55.117012 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:55.117628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:55.123680 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:55.124131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:55.124900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:55.125336 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:55.248747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:55.258049 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8ae0be0b-61ae-4f1f-bdac-f8895475dba4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.145097 Aug 27 04:20:55.258633 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 728/1424] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:55 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:56.276447 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:56.277019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:56.283832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:56.284271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:56.285029 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:56.285459 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:56.405171 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:56.413311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8cbb6749-4a7e-43f9-972c-194315b2546f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.141062 Aug 27 04:20:56.413959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 697/1425] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:56 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:57.429701 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:57.430598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:57.436409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:57.436862 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:57.437634 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:57.438068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:57.561566 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:57.569909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0d3fb7e9-eaaa-4338-bd41-2d68a8480c6f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.143864 Aug 27 04:20:57.570461 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 729/1426] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:57 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:58.586192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:58.586850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:58.592699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:58.593155 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:58.593929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:58.594369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:58.715996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:58.725555 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-eb4d5a03-b92b-4d68-a9d7-79f8969538ad tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.143009 Aug 27 04:20:58.726125 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 698/1427] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:58 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:20:59.742178 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:20:59.742818 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:20:59.748606 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:59.749052 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:59.749811 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:20:59.750240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:20:59.868488 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:20:59.876311 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-21bffbcf-e1c4-411a-9cdb-433ae84a771d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.137345 Aug 27 04:20:59.876883 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 730/1428] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:20:59 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:21:00.897182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:00.898070 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:00.904558 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:00.905012 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:00.905816 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:00.906255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:01.049480 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:01.057118 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8a3a9a71-7546-4608-b977-8d4f29ddb0f5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.163639 Aug 27 04:21:01.057686 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 699/1429] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:00 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:01.077950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-09e324a8-6d1d-4092-9f9f-bf812afd564f req-1d2a5180-299e-4c3f-be5c-95984e9eaa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28eee340-e8f2-4dfe-842a-05ddfc1eb40d", "name": "network-vif-plugged", "status": "completed", "tag": "7c6a20ee-51f2-41d8-92d2-c879bdd48024"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:01.079691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:21:01.079691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:21:01.088629 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-09e324a8-6d1d-4092-9f9f-bf812afd564f req-1d2a5180-299e-4c3f-be5c-95984e9eaa44 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:01.089078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-09e324a8-6d1d-4092-9f9f-bf812afd564f req-1d2a5180-299e-4c3f-be5c-95984e9eaa44 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:01.101372 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-09e324a8-6d1d-4092-9f9f-bf812afd564f req-1d2a5180-299e-4c3f-be5c-95984e9eaa44 service nova] Creating event network-vif-plugged:7c6a20ee-51f2-41d8-92d2-c879bdd48024 for instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d on hv-cinder-80475 Aug 27 04:21:01.106450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-09e324a8-6d1d-4092-9f9f-bf812afd564f req-1d2a5180-299e-4c3f-be5c-95984e9eaa44 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032128 Aug 27 04:21:01.107095 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 731/1430] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:21:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:02.073335 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:02.073953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:02.079856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:02.080303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:02.081074 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:02.081507 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:02.199885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:02.207657 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f1a5cdd3-9ddf-4590-b35e-268652c96661 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1362 microversion: 2.1 time: 0.138306 Aug 27 04:21:02.208224 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 700/1431] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:02 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1362 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:03.225736 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:03.226586 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:03.232898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:03.233296 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:03.234078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:03.234534 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:03.357198 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:03.365315 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-46396048-b7bb-4e36-a2ac-595af49d03c4 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1548 microversion: 2.1 time: 0.143688 Aug 27 04:21:03.365868 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 732/1432] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:03 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1548 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:03.381498 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:03.382031 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:03.387839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:03.388291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:03.389119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:03.389559 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:03.471377 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7d040dd9-0977-4945-98a1-60f8764f162b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093553 Aug 27 04:21:03.471982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 701/1433] 10.222.0.73 () {58 vars in 1275 bytes} [Fri Aug 27 04:21:03 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:04.469565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:04.470590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:04.472067 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-89495193-0f52-496f-a01e-80659c6fad2f req-1524f12e-9a24-4204-b975-198104b8f4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28eee340-e8f2-4dfe-842a-05ddfc1eb40d", "tag": "7c6a20ee-51f2-41d8-92d2-c879bdd48024"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:04.474217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:21:04.474217 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:21:04.476760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:04.477381 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:04.478177 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:04.478637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:04.482068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-89495193-0f52-496f-a01e-80659c6fad2f req-1524f12e-9a24-4204-b975-198104b8f4a7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:04.482715 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-89495193-0f52-496f-a01e-80659c6fad2f req-1524f12e-9a24-4204-b975-198104b8f4a7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:04.494898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-89495193-0f52-496f-a01e-80659c6fad2f req-1524f12e-9a24-4204-b975-198104b8f4a7 service nova] Creating event network-changed:7c6a20ee-51f2-41d8-92d2-c879bdd48024 for instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d on hv-cinder-80475 Aug 27 04:21:04.500226 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-89495193-0f52-496f-a01e-80659c6fad2f req-1524f12e-9a24-4204-b975-198104b8f4a7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032089 Aug 27 04:21:04.502107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 702/1434] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:21:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:21:04.594344 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2ab75ef6-81fe-4a0a-aa1f-cfa57db9acb7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.128433 Aug 27 04:21:04.595242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 733/1435] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:04 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:05.605880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:05.606827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:05.613133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:05.613582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:05.614354 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:05.614827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:05.692930 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-24f585d2-f6bc-4d64-98f9-21fb44cac0cf tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.090997 Aug 27 04:21:05.696736 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 703/1436] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:05 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:06.704293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:06.705279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:06.711738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:06.712192 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:06.712965 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:06.713403 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:06.792109 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-994987ad-e355-4888-baf4-2ae7739b1d1f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.091667 Aug 27 04:21:06.792636 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 734/1437] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:06 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:07.803273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:07.804550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:07.811369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:07.811815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:07.812595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:07.813732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:07.892628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fe2a886c-2fa2-4960-8302-6777267bd970 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.093209 Aug 27 04:21:07.893257 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 704/1438] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:07 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:08.903939 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:08.904916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:08.912093 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:08.912547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:08.914078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:08.914078 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:09.001815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7ae450c0-25e3-4cfd-8531-4348dbe304a0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.101780 Aug 27 04:21:09.002713 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 735/1439] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:08 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:21:10.013559 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:10.014729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:10.021359 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:10.021830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:10.022626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:10.023115 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:10.103033 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-341a331e-1da0-45da-a08f-63ddd6b704db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.093462 Aug 27 04:21:10.103654 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 705/1440] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:10 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 27 04:21:11.115243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:11.116236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:11.122758 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:11.123214 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:11.123985 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:11.124425 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:11.202908 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e91809f0-44e9-4d02-af66-97f7a2b65aa1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.091633 Aug 27 04:21:11.204012 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 736/1441] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:11 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:12.213899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:12.214920 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:12.221773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:12.222230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:12.223049 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:12.223493 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:12.317044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-37ac3c55-d6d9-4041-bd94-59bad8ae85b6 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.106875 Aug 27 04:21:12.318914 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 706/1442] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:12 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:13.329637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:13.331226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:13.337796 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:13.338250 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:13.339057 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:13.339492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:13.418374 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-cf1a63f0-a06d-4838-8735-f95204947e23 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.092655 Aug 27 04:21:13.419013 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 737/1443] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:13 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:14.429089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:14.430332 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:14.436926 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:14.437369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:14.438131 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:14.438579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:14.521190 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-beb8f84d-7ad2-47b9-ae26-9e764a9f931a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 14 microversion: 2.1 time: 0.096093 Aug 27 04:21:14.521829 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 707/1444] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:14 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:21:15.532613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:15.533800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:15.540319 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:15.540770 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:15.541539 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:15.541975 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:15.653361 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-57fe0638-62e8-4efd-90cd-2762bc1b0f73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 10009 microversion: 2.1 time: 0.124740 Aug 27 04:21:15.653987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 738/1445] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:15 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 10009 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:16.665499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:16.666478 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:16.672859 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:16.673300 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:16.674054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:16.674485 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:16.769303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a6497e87-e5e0-48a1-a45d-215afcd867c5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 17861 microversion: 2.1 time: 0.107603 Aug 27 04:21:16.769951 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 708/1446] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:16 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 17861 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:17.781283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:17.782268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:17.788916 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:17.789370 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:17.790140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:17.790597 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:17.877154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-85fc7809-bb35-4be4-a54f-073e2ef336c2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 19133 microversion: 2.1 time: 0.099755 Aug 27 04:21:17.877866 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 739/1447] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:17 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 19133 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:18.889050 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:18.890041 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:18.897216 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:18.897633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:18.898403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:18.898875 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:18.996261 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cd58bba1-47fb-42dc-9a5e-f7a88aab2435 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 21790 microversion: 2.1 time: 0.111134 Aug 27 04:21:18.997899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 709/1448] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:18 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 21790 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:20.008386 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:20.009379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:20.016125 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:20.016580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:20.017348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:20.017785 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:20.104363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-6407726c-55f3-4318-acc0-6e304b027fee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 23235 microversion: 2.1 time: 0.099910 Aug 27 04:21:20.105004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 740/1449] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:20 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 23235 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:21.116908 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:21.117898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:21.124374 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:21.124822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:21.125595 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:21.126034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:21.218950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-02250442-3275-4c0e-98e9-0069ee047451 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 24589 microversion: 2.1 time: 0.106573 Aug 27 04:21:21.219573 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 710/1450] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:21 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 24589 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:22.232258 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:22.233171 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:22.240476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:22.240926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:22.241760 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:22.242200 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:22.333069 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-2f6c2580-fd61-4da8-99e6-9f704422b0f7 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 26253 microversion: 2.1 time: 0.104803 Aug 27 04:21:22.333776 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 741/1451] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:22 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 26253 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:23.347133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:23.351742 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:23.358425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:23.358913 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:23.359699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:23.360138 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:23.451411 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-18cd882e-2b2f-4705-af4a-033b01821a59 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 27527 microversion: 2.1 time: 0.108148 Aug 27 04:21:23.452060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 711/1452] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:23 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 27527 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:24.463689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:24.464677 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:24.471204 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:24.471654 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:24.472431 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:24.472870 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:24.567685 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-39832e17-a300-416c-aa9a-89bcf4a0017c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 27933 microversion: 2.1 time: 0.107757 Aug 27 04:21:24.568243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 742/1453] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:24 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 27933 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:25.579918 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:25.580840 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:25.588208 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:25.588664 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:25.589467 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:25.589904 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:25.699136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f2529a81-61bf-4d06-b451-3e1cb59eba4c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28197 microversion: 2.1 time: 0.123378 Aug 27 04:21:25.699763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 712/1454] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:25 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:26.711199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:26.712210 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:26.718704 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:26.720806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:26.720806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:26.720806 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:26.818140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ec0998de-bb9a-4f2f-9400-ab60228d345f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.110802 Aug 27 04:21:26.819197 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 743/1455] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:26 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:27.830054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:27.831072 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:27.837597 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:27.838043 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:27.838846 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:27.839279 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:27.923169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2a71a99a-1af9-4630-b962-49d4929ce7d8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.097184 Aug 27 04:21:27.923825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 713/1456] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:27 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:28.935589 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:28.936620 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:28.943628 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:28.947490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:28.947490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:28.947490 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:29.028096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-0c8d688d-369c-4da9-a244-74e28b6c05d1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.096292 Aug 27 04:21:29.028751 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 744/1457] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:28 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:30.040814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:30.041797 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:30.048262 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:30.048708 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:30.049470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:30.049901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:30.140508 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1c395190-75fa-47c9-8a92-90ced921fab3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.104286 Aug 27 04:21:30.141132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 714/1458] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:30 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:31.152898 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:31.153924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:31.160396 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:31.161656 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:31.162836 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:31.163285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:31.261585 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-832bb6e3-30e2-4a6e-9a88-686dc6a85a3c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.112574 Aug 27 04:21:31.262133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 745/1459] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:31 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:32.272966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:32.273879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:32.280528 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:32.280977 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:32.281747 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:32.282186 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:32.371833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-66fc056a-c26d-41d0-87e9-5156c2d26cb8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.103004 Aug 27 04:21:32.375784 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 715/1460] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:32 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:32.799018 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:32.800189 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:32.808911 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-56da04cf-162d-4068-8078-d55926e2d369 req-85af8c69-b578-43e0-b23a-9d1b1f0c9e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6db3235e-3d16-49bd-81b7-d66f8a7b869c", "tag": "0ec77322-46d4-445f-9d96-1b0364722727"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:32.810413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:21:32.810413 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:21:32.817745 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:32.821036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:32.821036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:32.821036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:32.827024 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-56da04cf-162d-4068-8078-d55926e2d369 req-85af8c69-b578-43e0-b23a-9d1b1f0c9e83 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:32.827425 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-56da04cf-162d-4068-8078-d55926e2d369 req-85af8c69-b578-43e0-b23a-9d1b1f0c9e83 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:32.839161 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-56da04cf-162d-4068-8078-d55926e2d369 req-85af8c69-b578-43e0-b23a-9d1b1f0c9e83 service nova] Creating event network-changed:0ec77322-46d4-445f-9d96-1b0364722727 for instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c on hv-cinder-80475 Aug 27 04:21:32.844881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:21:32.848065 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-56da04cf-162d-4068-8078-d55926e2d369 req-85af8c69-b578-43e0-b23a-9d1b1f0c9e83 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040085 Aug 27 04:21:32.848065 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 716/1461] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:33.242688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f82a73a3-bcce-462e-b6be-f47a6f828079 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "DELETE /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 204 len: 0 microversion: 2.1 time: 0.447436 Aug 27 04:21:33.243525 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 746/1462] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:21:32 2021] DELETE /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:21:33.252426 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:33.252886 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:33.260403 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:33.260764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:33.261546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:33.261982 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:33.385479 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:33.386487 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:33.392439 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:33.399920 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:33.400076 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:33.400542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:33.400542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:33.404752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5cefb7f5-a3d8-4e0b-888e-a8f3319de8e4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1577 microversion: 2.1 time: 0.156489 Aug 27 04:21:33.406215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 717/1463] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:33 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:33.491157 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-932952f1-8b0f-482c-87b2-9b48e534583e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.110308 Aug 27 04:21:33.494590 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 747/1464] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:33 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:34.422879 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:34.423484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:34.430924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:34.431371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:34.432132 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:34.432564 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:34.503399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:34.504380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:34.510794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:34.516925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:34.516925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:34.516925 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:34.557641 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:34.565243 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c6bbab2a-8ce2-4da8-be97-fe2c3ec6f714 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1458 microversion: 2.1 time: 0.146074 Aug 27 04:21:34.565806 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 718/1465] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:34 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1458 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:34.725085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-45727c6b-6164-49f3-87bd-f5db8d1ecb94 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.225471 Aug 27 04:21:34.725690 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 748/1466] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:34 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:35.585537 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:35.586117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:35.591936 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:35.592388 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:35.593170 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:35.593612 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:35.718894 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:35.727341 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f90189ec-255d-4ca6-afe1-b41ec398aed4 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1458 microversion: 2.1 time: 0.146268 Aug 27 04:21:35.727933 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 719/1467] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:35 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1458 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:35.736002 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:35.737091 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:35.744293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:35.744754 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:35.745547 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:35.745994 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:35.841546 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7c194d40-125f-43de-8df7-c4c772a5058a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.109240 Aug 27 04:21:35.842120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 749/1468] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:35 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:35.965718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-e8a9d9ba-927e-477b-b54d-d7ef255d3711 req-cdc02b6f-7c92-4662-ad03-3075aeb45861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6db3235e-3d16-49bd-81b7-d66f8a7b869c", "name": "network-vif-deleted", "tag": "0ec77322-46d4-445f-9d96-1b0364722727"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:35.967255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:21:35.967255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:21:35.974646 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-e8a9d9ba-927e-477b-b54d-d7ef255d3711 req-cdc02b6f-7c92-4662-ad03-3075aeb45861 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:35.975093 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-e8a9d9ba-927e-477b-b54d-d7ef255d3711 req-cdc02b6f-7c92-4662-ad03-3075aeb45861 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:35.985937 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-e8a9d9ba-927e-477b-b54d-d7ef255d3711 req-cdc02b6f-7c92-4662-ad03-3075aeb45861 service nova] Creating event network-vif-deleted:0ec77322-46d4-445f-9d96-1b0364722727 for instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c on hv-cinder-80475 Aug 27 04:21:35.991037 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-e8a9d9ba-927e-477b-b54d-d7ef255d3711 req-cdc02b6f-7c92-4662-ad03-3075aeb45861 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028917 Aug 27 04:21:35.991627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 720/1469] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:21:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:36.745179 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:36.745914 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:36.752626 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:36.753308 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:36.753841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:36.754282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:36.785354 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:36.785801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:36.786305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lazy-loading 'fault' on Instance uuid 6db3235e-3d16-49bd-81b7-d66f8a7b869c {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:21:36.826808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:36.834691 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-26df1443-5021-4891-8f61-24bb5e99ec8e tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 200 len: 1231 microversion: 2.1 time: 0.093517 Aug 27 04:21:36.835259 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 750/1470] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:36 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:36.854790 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:36.855779 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:36.861837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:36.862371 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:36.863344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:36.863788 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:37.006421 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-946d5379-4728-4cb1-ba59-5e7a45141f13 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.156796 Aug 27 04:21:37.007047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 721/1471] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:36 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:37.851792 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:37.852326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: 6db3235e-3d16-49bd-81b7-d66f8a7b869c] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:37.858661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:37.859059 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:37.859833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:37.860273 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:37.873188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] HTTP exception thrown: Instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c could not be found. Aug 27 04:21:37.873768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Returning 404 to user: Instance 6db3235e-3d16-49bd-81b7-d66f8a7b869c could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:21:37.874598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bef3a05e-932b-4b77-91cf-9fd730f2f98d tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c" status: 404 len: 111 microversion: 2.1 time: 0.026813 Aug 27 04:21:37.875120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 751/1472] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:37 2021] GET /compute/v2.1/servers/6db3235e-3d16-49bd-81b7-d66f8a7b869c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:21:38.018688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:38.019688 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:38.026308 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:38.026811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:38.027592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:38.028040 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:38.116752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-46fc990f-087d-4c9b-bab6-5c4220f680e1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.101991 Aug 27 04:21:38.117409 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 722/1473] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:38 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:39.128412 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:39.129349 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:39.135523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:39.135980 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:39.136766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:39.137206 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:39.216484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:21:39.217060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:21:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:21:39.222922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b7463847-a437-4ec4-9382-6c01f9612b61 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.097924 Aug 27 04:21:39.223561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 752/1474] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:39 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:40.235780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:40.236819 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:40.243345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:40.243795 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:40.244567 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:40.245000 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:40.330726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-098ea229-084b-448e-87ca-fe0551fbbfbc tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.098931 Aug 27 04:21:40.335858 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 723/1475] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:40 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:41.198450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-54bdcb3f-208f-4cde-a7f1-c93e2f091b4a req-1bb9dc4a-1dbb-4331-9f50-f469889e668e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e576b6e1-2799-4b05-bbe8-c066224ac592", "tag": "f611f852-dde7-48c6-9dcf-d14f5a8b27a9"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:41.199932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:21:41.199932 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:21:41.205474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:41.206071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:41.213921 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.214379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.215032 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-54bdcb3f-208f-4cde-a7f1-c93e2f091b4a req-1bb9dc4a-1dbb-4331-9f50-f469889e668e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.215225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.215483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-54bdcb3f-208f-4cde-a7f1-c93e2f091b4a req-1bb9dc4a-1dbb-4331-9f50-f469889e668e service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.215716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.227034 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-54bdcb3f-208f-4cde-a7f1-c93e2f091b4a req-1bb9dc4a-1dbb-4331-9f50-f469889e668e service nova] Creating event network-changed:f611f852-dde7-48c6-9dcf-d14f5a8b27a9 for instance e576b6e1-2799-4b05-bbe8-c066224ac592 on hv-cinder-80475 Aug 27 04:21:41.231901 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-54bdcb3f-208f-4cde-a7f1-c93e2f091b4a req-1bb9dc4a-1dbb-4331-9f50-f469889e668e service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037387 Aug 27 04:21:41.232737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 724/1476] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:21:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:41.243770 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:21:41.348509 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:41.350546 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:41.363885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.366076 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.367237 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.367850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.460501 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ecf784c7-b72a-4f78-af91-cb23b9fea0a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.117594 Aug 27 04:21:41.462185 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 725/1477] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:41 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:41.527957 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-854b1bd6-9cec-47b5-a017-95a0cc42cda8 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 204 len: 0 microversion: 2.1 time: 0.337074 Aug 27 04:21:41.531888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 753/1478] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:21:41 2021] DELETE /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:21:41.538777 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:41.539611 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:41.545996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.546543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.547461 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:41.547963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:41.681704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:41.689270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-58773fbf-2ebb-4709-9b58-626b1af6d4ad tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1576 microversion: 2.1 time: 0.155957 Aug 27 04:21:41.689839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 726/1479] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:41 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:42.474454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:42.475668 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:42.482087 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:42.482542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:42.483351 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:42.483794 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:42.590888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-58770ca5-81b9-4f7e-ae6c-f42c2e9e9b79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28314 microversion: 2.1 time: 0.120877 Aug 27 04:21:42.591517 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 754/1480] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:42 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28314 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:42.706633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:42.707248 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:42.713575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:42.714027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:42.714839 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:42.715270 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:42.839119 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:42.846377 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ff0699c9-ade6-41bc-b292-095c9778bb5f tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1458 microversion: 2.1 time: 0.143486 Aug 27 04:21:42.846961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 727/1481] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:42 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1458 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:43.168434 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-63a7fd81-9f27-46cc-b355-197af47113d6 req-53dcce02-3d4f-4f31-be00-90c7d5b4df33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e576b6e1-2799-4b05-bbe8-c066224ac592", "name": "network-vif-deleted", "tag": "f611f852-dde7-48c6-9dcf-d14f5a8b27a9"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:43.169922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:21:43.169922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:21:43.177406 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-63a7fd81-9f27-46cc-b355-197af47113d6 req-53dcce02-3d4f-4f31-be00-90c7d5b4df33 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:43.182815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-63a7fd81-9f27-46cc-b355-197af47113d6 req-53dcce02-3d4f-4f31-be00-90c7d5b4df33 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:43.188644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-63a7fd81-9f27-46cc-b355-197af47113d6 req-53dcce02-3d4f-4f31-be00-90c7d5b4df33 service nova] Creating event network-vif-deleted:f611f852-dde7-48c6-9dcf-d14f5a8b27a9 for instance e576b6e1-2799-4b05-bbe8-c066224ac592 on hv-cinder-80475 Aug 27 04:21:43.193497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-63a7fd81-9f27-46cc-b355-197af47113d6 req-53dcce02-3d4f-4f31-be00-90c7d5b4df33 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029109 Aug 27 04:21:43.194061 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 755/1482] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:21:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:21:43.602719 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:43.603575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:43.609507 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:43.611011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:43.611011 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:43.611312 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:43.716937 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4458fc6f-018b-4c8c-957d-1c6edbce39ce tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28605 microversion: 2.1 time: 0.118010 Aug 27 04:21:43.717584 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 728/1483] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:43 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28605 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:43.864399 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:43.865520 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:43.871557 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:43.872005 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:43.872767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:43.873191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:43.902702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:43.903186 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:43.903640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lazy-loading 'fault' on Instance uuid e576b6e1-2799-4b05-bbe8-c066224ac592 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:21:43.942470 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ca683634884d9f8af26dba5bbea16f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98836f9ced7149bc904274a5add221ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:21:43.950180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-23b6b496-b66a-4ceb-a9a4-ebd7dd5ce20b tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 200 len: 1230 microversion: 2.1 time: 0.089992 Aug 27 04:21:43.950867 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 756/1484] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:43 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 1230 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:21:44.729548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:44.730481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:44.736925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:44.737379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:44.738147 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:44.738610 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:44.836903 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-5b3eb8b7-a70a-4a0b-a01e-93ce3442ba08 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28605 microversion: 2.1 time: 0.111330 Aug 27 04:21:44.837550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 729/1485] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:44 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28605 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:44.983684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:44.984236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: e576b6e1-2799-4b05-bbe8-c066224ac592] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:44.990604 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:44.991056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:44.991821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:44.992253 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.005057 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] HTTP exception thrown: Instance e576b6e1-2799-4b05-bbe8-c066224ac592 could not be found. Aug 27 04:21:45.006277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Returning 404 to user: Instance e576b6e1-2799-4b05-bbe8-c066224ac592 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:21:45.007120 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-24a8933c-ca06-4df4-87dc-c88bd2f1b9cf tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592" status: 404 len: 111 microversion: 2.1 time: 0.027211 Aug 27 04:21:45.007640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 757/1486] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:44 2021] GET /compute/v2.1/servers/e576b6e1-2799-4b05-bbe8-c066224ac592 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:21:45.545047 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:45.547150 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:45.552970 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:45.553431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.554259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:45.554728 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.568925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] HTTP exception thrown: Instance fc4b2954-16f9-4141-9977-dd55b199c106 could not be found. Aug 27 04:21:45.569518 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Returning 404 to user: Instance fc4b2954-16f9-4141-9977-dd55b199c106 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:21:45.570339 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f2a81235-3d39-441d-bb4e-fe5bf4d9c5dd tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "DELETE /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 404 len: 111 microversion: 2.1 time: 0.029358 Aug 27 04:21:45.570991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 730/1487] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:21:45 2021] DELETE /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:21:45.578964 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:45.579580 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] [instance: fc4b2954-16f9-4141-9977-dd55b199c106] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:45.585583 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:45.585974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.586787 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:45.587226 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.599893 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] HTTP exception thrown: Instance fc4b2954-16f9-4141-9977-dd55b199c106 could not be found. Aug 27 04:21:45.600471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Returning 404 to user: Instance fc4b2954-16f9-4141-9977-dd55b199c106 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:21:45.601281 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7180d01e-6711-4fa1-bf08-46e632654e85 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106" status: 404 len: 111 microversion: 2.1 time: 0.025991 Aug 27 04:21:45.601788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 758/1488] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:21:45 2021] GET /compute/v2.1/servers/fc4b2954-16f9-4141-9977-dd55b199c106 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:21:45.848442 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:45.850054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:45.855837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:45.856298 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.857156 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:45.857592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:45.957613 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c3059b8b-61f5-4c3b-b4be-6cd20cb40e0e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.112754 Aug 27 04:21:45.958978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 731/1489] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:45 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:46.969265 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:46.970191 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:46.978896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:46.978896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:46.978896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:46.978896 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:47.074930 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-69fd1eb9-4445-4a65-bddc-c8bd69074497 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.109088 Aug 27 04:21:47.075767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 759/1490] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:46 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:47.095632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-ee6e3be1-cf3c-4489-b27f-10b523b14472 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] Calling method '.version_select at 0x7f539339b8b0>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:21:47.174823 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-ee6e3be1-cf3c-4489-b27f-10b523b14472 tempest-TestVolumeBootPattern-1587185829 tempest-TestVolumeBootPattern-1587185829-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1777048250" status: 202 len: 0 microversion: 2.1 time: 0.083133 Aug 27 04:21:47.175408 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 732/1491] 10.222.0.73 () {58 vars in 1263 bytes} [Fri Aug 27 04:21:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1777048250 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:21:48.088379 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:48.089570 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:48.096023 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:48.096476 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:48.097261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:48.097702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:48.190276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a0bc005c-4c00-4ccc-bae0-c6ba9107a7b2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.107250 Aug 27 04:21:48.191322 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 760/1492] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:48 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:49.204646 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:49.206369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:49.215210 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:49.215800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:49.216596 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:49.217098 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:49.328885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-60e1928d-a815-4a76-9e0b-2a35b6228065 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.127991 Aug 27 04:21:49.332828 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 733/1493] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:49 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:50.341148 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:50.342243 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:50.349509 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:50.349966 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:50.350982 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:50.351613 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:50.444684 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f0e41c89-7a07-46a4-adc3-704b948932a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.107423 Aug 27 04:21:50.445506 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 761/1494] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:50 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:51.463552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:51.463552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:51.466398 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:51.466895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:51.467693 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:51.468193 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:51.570220 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1524b73b-2512-4e19-bf48-acdd015dc9f0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.116944 Aug 27 04:21:51.574533 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 734/1495] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:51 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:52.582750 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:52.584367 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:52.590779 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:52.591232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:52.592011 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:52.592456 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:52.691349 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4e5f108a-ee79-458a-8aee-4782e0143206 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.112411 Aug 27 04:21:52.695843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 762/1496] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:52 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:53.704179 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:53.705168 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:53.712275 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:53.712726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:53.713497 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:53.713964 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:53.794691 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6ad8134b-30a0-4167-ba64-30fc09cdb6e9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.094451 Aug 27 04:21:53.799997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 735/1497] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:53 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:54.817115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:54.817115 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:54.821991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:54.822454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:54.823279 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:54.823720 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:54.905131 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-99fa1bc6-5e00-44c8-a2d2-97f3ccb76c34 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.100123 Aug 27 04:21:54.906545 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 763/1498] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:54 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:55.918068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:55.919085 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:55.925550 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:55.926006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:55.926885 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:55.927325 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:56.010856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-89effcfc-515e-407e-851e-be8bc6b304f9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.096743 Aug 27 04:21:56.011791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 736/1499] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:55 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:21:57.023075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:57.024107 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:57.030544 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:57.031036 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:57.031801 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:57.032232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:57.113149 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4894e98c-ccc4-4fdb-9100-0d9d1e197344 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.094138 Aug 27 04:21:57.114098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 764/1500] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:57 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:58.126052 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:58.127073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:58.134283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:58.134771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:58.135548 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:58.135983 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:58.229838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2d58ec38-4147-4052-b7d9-2732f5d4013f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.107599 Aug 27 04:21:58.230438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 737/1501] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:58 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:21:59.242650 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:21:59.243778 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:21:59.250458 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:59.250947 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:59.251990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:21:59.252725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:21:59.340552 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e3ae0d7e-8380-4b32-a31d-f7e7d6057728 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.102422 Aug 27 04:21:59.341285 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 765/1502] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:21:59 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:00.354304 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:00.355281 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:00.361730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:00.362182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:00.362997 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:00.363438 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:00.442376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-71fd18b2-f88c-46e1-9eac-b03b8d97df76 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.091993 Aug 27 04:22:00.443073 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 738/1503] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:00 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:22:01.454362 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:01.455382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:01.461842 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:01.462290 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:01.463100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:01.463538 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:01.542471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b675a3c7-c40d-4d45-84e8-49fa871df94b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.091940 Aug 27 04:22:01.543179 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 766/1504] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:01 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:02.555463 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:02.556457 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:02.563066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:02.563505 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:02.564284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:02.564893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:02.653644 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3c516452-e1e5-400b-8b9d-dc1c0eee1ceb tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.102803 Aug 27 04:22:02.654296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 739/1505] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:02 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:22:03.666221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:03.667242 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:03.673621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:03.674067 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:03.674858 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:03.675299 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:03.762096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d0e217cf-8880-4517-82e8-30e88980ad7c tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.099754 Aug 27 04:22:03.762722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 767/1506] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:03 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:04.773740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:04.774774 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:04.781151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:04.781593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:04.782353 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:04.782815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:04.872290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-99337309-edcf-4ec4-bccb-140358d4dfb9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.102566 Aug 27 04:22:04.872949 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 740/1507] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:04 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:05.884181 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:05.885160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:05.891533 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:05.891967 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:05.892730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:05.893166 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:05.975248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-140a0940-a934-47a9-8f6e-807c3fb67c79 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.094976 Aug 27 04:22:05.975909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 768/1508] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:05 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:06.987306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:06.988310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:06.995430 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:06.995882 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:06.996669 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:06.997106 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:07.077776 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f287fad3-1c48-405f-96cb-8a03fde0bd73 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.094665 Aug 27 04:22:07.078434 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 741/1509] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:06 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:08.089788 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:08.090846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:08.097275 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:08.097735 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:08.099098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:08.099548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:08.181531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-dabb55d2-f6bb-475a-b514-665964716f43 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.095658 Aug 27 04:22:08.182156 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 769/1510] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:08 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:09.193978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:09.195015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:09.201366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:09.201811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:09.202582 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:09.203028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:09.283019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-31b92dfe-cb80-4214-ab37-0ef5983d1947 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.093289 Aug 27 04:22:09.283800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 742/1511] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:09 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:10.295173 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:10.296094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:10.303241 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:10.303694 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:10.304463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:10.304902 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:10.404188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8a24a44a-ae30-49f5-8002-34a38456a593 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.113045 Aug 27 04:22:10.404809 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 770/1512] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:10 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:11.415726 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:11.416718 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:11.423121 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:11.423572 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:11.424344 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:11.424782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:11.507925 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-659600a1-35b8-4ed1-8491-5f92bfbc95a5 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.096117 Aug 27 04:22:11.508577 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 743/1513] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:11 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:12.519387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:12.520937 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:12.527674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:12.528180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:12.529026 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:12.529492 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:12.613227 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1635214d-5e32-4552-8999-5050cec5d0e3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.097789 Aug 27 04:22:12.613918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 771/1514] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:12 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:13.625893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:13.626959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:13.633810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:13.634263 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:13.635133 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:13.635566 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:13.718247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-162db788-1909-4f70-959d-62dad691687d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.096630 Aug 27 04:22:13.719003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 744/1515] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:13 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:14.729798 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:14.730821 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:14.737234 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:14.737688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:14.738584 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:14.739548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:14.820714 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-70243428-3ab6-4cb6-81c7-2ecf03baf8d9 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.094860 Aug 27 04:22:14.821348 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 772/1516] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:14 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:15.833507 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:15.834481 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:15.841124 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:15.841579 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:15.842358 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:15.842825 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:15.928044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7958e9c0-8352-452f-b450-8c356b89b398 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.099058 Aug 27 04:22:15.928939 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 745/1517] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:15 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:16.940963 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:16.942071 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:16.948607 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:16.949053 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:16.949815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:16.950248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:17.034984 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-75614f63-c5d9-4d70-9bd6-11396834877b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.097917 Aug 27 04:22:17.036721 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 773/1518] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:16 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:18.047539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:18.048527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:18.055809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:18.056260 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:18.057028 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:18.057464 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:18.136384 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-995c443d-c292-4918-a963-ead0e9f3fc2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.092733 Aug 27 04:22:18.137015 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 746/1519] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:18 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:19.148404 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:19.149420 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:19.155802 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:19.156248 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:19.157010 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:19.157450 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:19.240950 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-22b0495f-80eb-481a-8db4-15a3319511aa tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.096340 Aug 27 04:22:19.241493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 774/1520] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:19 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:20.252286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:20.253207 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:20.260227 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:20.260680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:20.261446 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:20.261880 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:20.352822 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f9d0adea-11d1-4180-9409-4ec43b6d3208 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.104531 Aug 27 04:22:20.353454 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 747/1521] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:20 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:21.364341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:21.366148 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:21.372556 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:21.373003 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:21.373769 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:21.374199 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:21.454815 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7013d891-542b-4958-ba92-4448ebdec0db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.094447 Aug 27 04:22:21.455416 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 775/1522] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:21 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:22:22.467847 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:22.468834 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:22.476003 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:22.476452 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:22.477212 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:22.477642 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:22.561370 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a6b866b9-335a-4cba-8ed7-0ebe13830621 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 28773 microversion: 2.1 time: 0.097417 Aug 27 04:22:22.562035 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 748/1523] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:22 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 28773 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:23.573808 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:23.574839 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:23.581282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:23.581738 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:23.582523 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:23.582987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:23.685643 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-51d49031-7df7-4a18-a011-1634363f2c16 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 30863 microversion: 2.1 time: 0.115758 Aug 27 04:22:23.686332 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 776/1524] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:23 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 30863 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:24.698230 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:24.699284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:24.705615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:24.706060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:24.706850 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:24.707283 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:24.796014 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-8380e3d8-3968-4be7-a307-18500e113bb3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 32564 microversion: 2.1 time: 0.101634 Aug 27 04:22:24.796684 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 749/1525] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:24 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 32564 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:25.807469 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:25.808452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:25.814909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:25.815356 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:25.816118 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:25.816554 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:25.907953 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-1aecefef-1a1c-4914-8b89-a7afd001681a tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 33659 microversion: 2.1 time: 0.104637 Aug 27 04:22:25.908565 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 777/1526] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:25 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 33659 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:26.920272 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:26.921265 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:26.928177 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:26.928626 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:26.929399 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:26.929833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:27.025227 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-881cd625-fa79-44ad-88d6-e577ce6e21bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 35022 microversion: 2.1 time: 0.108743 Aug 27 04:22:27.025899 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 750/1527] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:26 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 35022 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:28.037938 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:28.107196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:28.107196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:28.107196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:28.107196 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:28.107637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:28.141154 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b4f6ec0e-aafa-4ce1-b28e-12c9667cc296 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 36673 microversion: 2.1 time: 0.107441 Aug 27 04:22:28.141797 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 778/1528] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:28 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 36673 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:29.153450 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:29.154436 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:29.161946 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:29.162395 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:29.163199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:29.163632 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:29.263987 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-48607565-0453-414a-aa39-7739fc54427d tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 38234 microversion: 2.1 time: 0.114294 Aug 27 04:22:29.264586 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 751/1529] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:29 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 38234 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:30.276307 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:30.277211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:30.283637 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:30.284080 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:30.284843 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:30.285274 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:30.374246 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d708b01b-3084-4781-885b-a6c44849f854 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 38308 microversion: 2.1 time: 0.101953 Aug 27 04:22:30.374881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 779/1530] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:30 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 38308 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:31.386762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:31.387780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:31.394087 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:31.394540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:31.395539 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:31.395943 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:31.494174 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-388a4049-ad9e-4510-bbec-0877fbb4e717 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 38308 microversion: 2.1 time: 0.111301 Aug 27 04:22:31.495100 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 752/1531] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:31 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 38308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:32.511408 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:32.512388 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:32.518718 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:32.524774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:32.524774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:32.524774 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:32.603669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ce4e4439-df53-4e75-bdac-d06402c2d830 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 38308 microversion: 2.1 time: 0.096272 Aug 27 04:22:32.604303 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 780/1532] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:32 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 38308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 27 04:22:33.616838 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:33.617764 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:33.624273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:33.624729 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:33.625552 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:33.625992 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:33.711306 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-211da69f-c670-4d89-b003-242533417a8f tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 38308 microversion: 2.1 time: 0.098964 Aug 27 04:22:33.711942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 753/1533] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:33 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 38308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:34.724324 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:34.725340 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:34.731811 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:34.732261 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:34.733030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:34.733468 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:34.824722 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b44846de-3b33-461e-8f80-437f90c65e5b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action" status: 200 len: 38439 microversion: 2.1 time: 0.104954 Aug 27 04:22:34.825341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 781/1534] 10.222.0.73 () {60 vars in 1278 bytes} [Fri Aug 27 04:22:34 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/action => generated 38439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 27 04:22:34.836466 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:34.837077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:34.843540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:34.843993 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:34.844765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:34.845215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:34.869021 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-19553466-6fad-4abb-ba59-2db0a5709a58 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/ips" status: 200 len: 146 microversion: 2.1 time: 0.037575 Aug 27 04:22:34.869575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 754/1535] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Aug 27 04:22:34 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:37.517833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d555c4b-fb0c-4c54-9cfe-f6207d165a59"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:37.518990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:37.525494 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:37.525949 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:37.526747 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:37.527184 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:38.307846 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9d173efc-3e75-4886-a2ca-8f0827f56dcd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794001 Aug 27 04:22:38.308457 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 782/1536] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:22:37 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments => generated 194 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:22:45.825678 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:45.826725 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:45.833556 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:45.834007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:45.834808 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:45.835243 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:45.864213 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-346a8892-31c9-4c89-9543-6d91b53fa5a8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042344 Aug 27 04:22:45.864755 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 755/1537] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:22:45 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 27 04:22:45.875366 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:45.875947 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:45.881885 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:45.884188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:45.884188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:45.884188 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:45.914050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b56e9725-577c-4df9-9b06-d848c1b57a17 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/1d555c4b-fb0c-4c54-9cfe-f6207d165a59" status: 200 len: 194 microversion: 2.1 time: 0.043221 Aug 27 04:22:45.914648 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 783/1538] 10.222.0.73 () {58 vars in 1413 bytes} [Fri Aug 27 04:22:45 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/1d555c4b-fb0c-4c54-9cfe-f6207d165a59 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:47.518969 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c62f3b31-75c8-48a0-bf95-89298ec59b87"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:22:47.520551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:47.526245 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:47.530700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:47.530700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:47.530700 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:48.209434 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-4eb567a4-7f77-4548-a7db-0a90783048db tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694039 Aug 27 04:22:48.210200 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 756/1539] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:22:47 2021] POST /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:56.776271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:56.777232 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:56.783436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:56.783881 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:56.784639 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:56.785074 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:56.815483 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-38c14e84-2144-409d-b21e-05a0b26bc1c1 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043531 Aug 27 04:22:56.816029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 784/1540] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:22:56 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:57.076200 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:57.076773 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:57.083044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:57.083492 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:57.084291 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:57.084732 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:57.112499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1fa4b76a-b80e-42d4-b9ad-d16ffab31e9e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/1d555c4b-fb0c-4c54-9cfe-f6207d165a59" status: 200 len: 194 microversion: 2.1 time: 0.040878 Aug 27 04:22:57.113054 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 757/1541] 10.222.0.73 () {58 vars in 1413 bytes} [Fri Aug 27 04:22:57 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/1d555c4b-fb0c-4c54-9cfe-f6207d165a59 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:57.123531 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:57.124035 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:57.129730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:57.130180 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:57.131621 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:57.132075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:57.221031 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lazy-loading 'services' on Instance uuid 28eee340-e8f2-4dfe-842a-05ddfc1eb40d {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:22:57.456216 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-786d2c30-ee9c-4649-99cc-a79dcd35ecee tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/1d555c4b-fb0c-4c54-9cfe-f6207d165a59" status: 202 len: 0 microversion: 2.1 time: 0.336390 Aug 27 04:22:57.456797 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 785/1542] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:22:57 2021] DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/1d555c4b-fb0c-4c54-9cfe-f6207d165a59 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:22:59.632247 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:59.632737 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:59.638832 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:59.639286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:59.640053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:59.640488 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:59.668990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b2f1d024-d8dd-4058-8469-02d00087d763 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/c62f3b31-75c8-48a0-bf95-89298ec59b87" status: 200 len: 194 microversion: 2.1 time: 0.040652 Aug 27 04:22:59.669551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 758/1543] 10.222.0.73 () {58 vars in 1413 bytes} [Fri Aug 27 04:22:59 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/c62f3b31-75c8-48a0-bf95-89298ec59b87 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:22:59.680000 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:22:59.680833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:22:59.686841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:59.687288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:59.688047 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:22:59.688478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:22:59.772642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lazy-loading 'services' on Instance uuid 28eee340-e8f2-4dfe-842a-05ddfc1eb40d {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:23:00.048244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-96853139-4f45-4ea7-ba75-91864b4113c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/c62f3b31-75c8-48a0-bf95-89298ec59b87" status: 202 len: 0 microversion: 2.1 time: 0.372295 Aug 27 04:23:00.049385 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 786/1544] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:22:59 2021] DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments/c62f3b31-75c8-48a0-bf95-89298ec59b87 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:23:01.233199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:01.234145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:01.239843 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.242802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.242802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.242802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.269296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fa9e0660-131b-4095-8b17-42388ef184bd tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039800 Aug 27 04:23:01.269827 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 759/1545] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:23:01 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:23:01.379169 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:01.380247 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:01.386960 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.387409 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.388176 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.388610 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.416561 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f1e7af9c-58ff-4c3b-a78b-92d00cc4878b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041960 Aug 27 04:23:01.417094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 787/1546] 10.222.0.73 () {58 vars in 1302 bytes} [Fri Aug 27 04:23:01 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 27 04:23:01.480199 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:01.480702 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:01.486673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.494734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.494734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.494734 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.513165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:23:01.777609 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9f07b2eb-ec62-4082-957b-af3409a284ff tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 204 len: 0 microversion: 2.1 time: 0.300800 Aug 27 04:23:01.778182 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 760/1547] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:23:01 2021] DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:23:01.786041 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:01.788834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:01.793072 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.793514 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.794276 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:01.794767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:01.918858 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:01.926039 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-4fc116ab-bbef-4475-8c58-0f6414fb1758 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1673 microversion: 2.1 time: 0.143640 Aug 27 04:23:01.926653 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 788/1548] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:01 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:02.945414 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:02.946114 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:02.951998 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:02.952449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:02.953219 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:02.953655 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:03.078082 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:03.085287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-2ca021bd-5194-487c-a952-a13d51535637 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1673 microversion: 2.1 time: 0.144789 Aug 27 04:23:03.085841 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 761/1549] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:02 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1673 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:04.101907 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:04.102688 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:04.108422 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:04.108886 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:04.109665 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:04.110108 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:04.234100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:04.241595 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-262e722c-1fda-41dd-b248-1a15e5fba5c3 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1673 microversion: 2.1 time: 0.143640 Aug 27 04:23:04.242254 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 789/1550] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:04 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:04.814810 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-7278616d-fac1-4992-baf7-c7d608e9c3bf req-9ae9ee6b-61fd-4e35-84d5-3b8ca91a3b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28eee340-e8f2-4dfe-842a-05ddfc1eb40d", "name": "network-vif-deleted", "tag": "7c6a20ee-51f2-41d8-92d2-c879bdd48024"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:04.816303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:23:04.816303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:23:04.826177 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-7278616d-fac1-4992-baf7-c7d608e9c3bf req-9ae9ee6b-61fd-4e35-84d5-3b8ca91a3b8c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:04.826663 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-7278616d-fac1-4992-baf7-c7d608e9c3bf req-9ae9ee6b-61fd-4e35-84d5-3b8ca91a3b8c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:04.838931 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-7278616d-fac1-4992-baf7-c7d608e9c3bf req-9ae9ee6b-61fd-4e35-84d5-3b8ca91a3b8c service nova] Creating event network-vif-deleted:7c6a20ee-51f2-41d8-92d2-c879bdd48024 for instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d on hv-cinder-80475 Aug 27 04:23:04.844022 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-7278616d-fac1-4992-baf7-c7d608e9c3bf req-9ae9ee6b-61fd-4e35-84d5-3b8ca91a3b8c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Aug 27 04:23:04.844591 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 762/1551] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:23:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:23:05.258608 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:05.259330 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:05.265111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:05.265568 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:05.266346 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:05.266817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:05.298267 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:05.298756 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:05.299210 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lazy-loading 'fault' on Instance uuid 28eee340-e8f2-4dfe-842a-05ddfc1eb40d {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:23:05.338670 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eee45d5e088466d8ebf58a9755ea45d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e215cb584e04408bc95d37a5c81d1de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:23:05.346140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b4dd754c-b747-42b2-92cc-790facbdb9d2 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 200 len: 1327 microversion: 2.1 time: 0.091045 Aug 27 04:23:05.349478 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 790/1552] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:05 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 1327 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:23:06.364449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:06.365695 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:06.372627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:06.372627 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:06.372855 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:06.373256 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:06.386617 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] HTTP exception thrown: Instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d could not be found. Aug 27 04:23:06.387192 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Returning 404 to user: Instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:06.388019 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-cd5b399b-b621-4241-9993-b12c549bef31 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 404 len: 111 microversion: 2.1 time: 0.027664 Aug 27 04:23:06.388527 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 763/1553] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:06 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:06.397323 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5ef511f0-9fc9-41c9-a160-8226fb80b1ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '.version_select at 0x7f538e6c99d0>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:06.515029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5ef511f0-9fc9-41c9-a160-8226fb80b1ed tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-692100304" status: 202 len: 0 microversion: 2.1 time: 0.121890 Aug 27 04:23:06.515609 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 791/1554] 10.222.0.73 () {58 vars in 1218 bytes} [Fri Aug 27 04:23:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-692100304 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 27 04:23:09.848713 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:09.849818 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:09.855511 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:09.855958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:09.856730 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:09.857165 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:09.869910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] HTTP exception thrown: Instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d could not be found. Aug 27 04:23:09.870484 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Returning 404 to user: Instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:09.871330 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b470cf59-14b7-41f1-b48a-ce4897a7476b tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 404 len: 111 microversion: 2.1 time: 0.026265 Aug 27 04:23:09.871848 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 764/1555] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:23:09 2021] DELETE /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:09.879787 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:09.880400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 28eee340-e8f2-4dfe-842a-05ddfc1eb40d] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:09.886193 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:09.886672 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:09.887444 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:09.887909 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:09.901593 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] HTTP exception thrown: Instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d could not be found. Aug 27 04:23:09.902171 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Returning 404 to user: Instance 28eee340-e8f2-4dfe-842a-05ddfc1eb40d could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:09.903027 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a02b84f3-2533-4799-b8c6-eb7d99a4f6e8 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d" status: 404 len: 111 microversion: 2.1 time: 0.027344 Aug 27 04:23:09.903539 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 792/1556] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:09 2021] GET /compute/v2.1/servers/28eee340-e8f2-4dfe-842a-05ddfc1eb40d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:11.198545 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:11.199071 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:11.204783 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:11.205234 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:11.206007 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:11.206449 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:11.219958 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] HTTP exception thrown: Instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 could not be found. Aug 27 04:23:11.220541 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Returning 404 to user: Instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:11.221382 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6a0c73d2-760c-4b9d-a67c-49de776dc5d0 tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "DELETE /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 404 len: 111 microversion: 2.1 time: 0.026499 Aug 27 04:23:11.221900 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 765/1557] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:23:11 2021] DELETE /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:11.230411 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:11.231004 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] [instance: 45894587-8bff-45cc-ab9f-b8ec963e6ae5] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:23:11.236749 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:11.237203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:11.238017 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:23:11.238489 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:23:11.251926 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] HTTP exception thrown: Instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 could not be found. Aug 27 04:23:11.252514 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] Returning 404 to user: Instance 45894587-8bff-45cc-ab9f-b8ec963e6ae5 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:11.253329 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-15964c75-4a1b-4753-a26d-b393b3646f2e tempest-AttachVolumeTestJSON-1298579054 tempest-AttachVolumeTestJSON-1298579054-project] 10.222.0.73 "GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5" status: 404 len: 111 microversion: 2.1 time: 0.026760 Aug 27 04:23:11.253845 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 793/1558] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:23:11 2021] GET /compute/v2.1/servers/45894587-8bff-45cc-ab9f-b8ec963e6ae5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:16.809562 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c1a91984-1a31-4af6-b85d-bf954afebbaa tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Action: 'create', calling method: .version_select at 0x7f538f038f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1193514479", "metadata": {"Type": "work"}}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:16.810999 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-c1a91984-1a31-4af6-b85d-bf954afebbaa tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:16.811802 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-c1a91984-1a31-4af6-b85d-bf954afebbaa tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.110165 Aug 27 04:23:16.812310 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 766/1559] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Aug 27 04:23:16 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:23:16.821464 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7a36e077-531f-4eb3-9caf-9d634b1f5c5f tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Action: 'create', calling method: .version_select at 0x7f538e669ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1039585994", "metadata": {"Type": "work"}}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:16.822875 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7a36e077-531f-4eb3-9caf-9d634b1f5c5f tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:16.823659 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7a36e077-531f-4eb3-9caf-9d634b1f5c5f tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006282 Aug 27 04:23:16.824150 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 794/1560] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Aug 27 04:23:16 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 27 04:23:16.831804 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-320fb5f9-dc1f-4298-a05e-f3795265b0b2 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Action: 'create', calling method: .version_select at 0x7f538f0928b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1050246849", "metadata": {"Type": "work"}}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:23:16.832898 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-320fb5f9-dc1f-4298-a05e-f3795265b0b2 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:16.834765 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-320fb5f9-dc1f-4298-a05e-f3795265b0b2 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005273 Aug 27 04:23:16.835284 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 767/1561] 10.222.0.73 () {60 vars in 1156 bytes} [Fri Aug 27 04:23:16 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 27 04:23:16.843393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e40ad199-7602-4ce2-8a65-42c73687c7f8 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Calling method '.version_select at 0x7f538e6f1790>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:16.871879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-e40ad199-7602-4ce2-8a65-42c73687c7f8 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] HTTP exception thrown: Volume tempest-invalid-1102205161 could not be found. Aug 27 04:23:16.872474 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e40ad199-7602-4ce2-8a65-42c73687c7f8 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Returning 404 to user: Volume tempest-invalid-1102205161 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:16.873289 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e40ad199-7602-4ce2-8a65-42c73687c7f8 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1102205161" status: 404 len: 99 microversion: 2.1 time: 0.033389 Aug 27 04:23:16.873810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 795/1562] 10.222.0.73 () {58 vars in 1218 bytes} [Fri Aug 27 04:23:16 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1102205161 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 27 04:23:16.883462 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a604a803-1d00-47f1-8984-b9042fd2e7cf tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004632 Aug 27 04:23:16.883953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 768/1563] 10.222.0.73 () {58 vars in 1140 bytes} [Fri Aug 27 04:23:16 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:23:16.898059 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-8beab696-d947-4a42-83c2-6304c89f7b36 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007130 Aug 27 04:23:16.899030 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 796/1564] 10.222.0.73 () {58 vars in 1137 bytes} [Fri Aug 27 04:23:16 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 27 04:23:16.907468 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e487ad4f-4f91-4f41-841d-360a429213de tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Calling method '.version_select at 0x7f538f0be310>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:16.934148 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-e487ad4f-4f91-4f41-841d-360a429213de tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] HTTP exception thrown: Volume d89c2472-a9f4-42c9-87cf-c01110ed6a1f could not be found. Aug 27 04:23:16.934762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e487ad4f-4f91-4f41-841d-360a429213de tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Returning 404 to user: Volume d89c2472-a9f4-42c9-87cf-c01110ed6a1f could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:16.935601 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e487ad4f-4f91-4f41-841d-360a429213de tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "DELETE /compute/v2.1/os-volumes/d89c2472-a9f4-42c9-87cf-c01110ed6a1f" status: 404 len: 109 microversion: 2.1 time: 0.031895 Aug 27 04:23:16.936107 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 769/1565] 10.222.0.73 () {58 vars in 1248 bytes} [Fri Aug 27 04:23:16 2021] DELETE /compute/v2.1/os-volumes/d89c2472-a9f4-42c9-87cf-c01110ed6a1f => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:23:16.945316 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ec0792b5-3543-41de-8a29-80686f024ca3 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Calling method '.version_select at 0x7f538e6c9160>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:23:16.971172 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-ec0792b5-3543-41de-8a29-80686f024ca3 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] HTTP exception thrown: Volume 0d8a7c8f-1293-4273-977f-8d5a3fa99e21 could not be found. Aug 27 04:23:16.971762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-ec0792b5-3543-41de-8a29-80686f024ca3 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] Returning 404 to user: Volume 0d8a7c8f-1293-4273-977f-8d5a3fa99e21 could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:23:16.972588 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-ec0792b5-3543-41de-8a29-80686f024ca3 tempest-VolumesNegativeTest-91628570 tempest-VolumesNegativeTest-91628570-project] 10.222.0.73 "GET /compute/v2.1/os-volumes/0d8a7c8f-1293-4273-977f-8d5a3fa99e21" status: 404 len: 109 microversion: 2.1 time: 0.031451 Aug 27 04:23:16.973111 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 797/1566] 10.222.0.73 () {58 vars in 1245 bytes} [Fri Aug 27 04:23:16 2021] GET /compute/v2.1/os-volumes/0d8a7c8f-1293-4273-977f-8d5a3fa99e21 => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:24:33.994476 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-630825722", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "f9eb7a26-3cbe-4a98-a44c-9ba9695ebf5f"}]}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:34.196366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.network.neutron [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] validate_networks() for [('f9eb7a26-3cbe-4a98-a44c-9ba9695ebf5f', None, None, None, None, None)] {{(pid=108985) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:24:34.587665 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Flavor limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:24:34.588083 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Image limits 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:24:34.588551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Flavor pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:24:34.588961 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Image pref 0:0:0 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:24:34.589369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.virt.hardware [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108985) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:24:34.597857 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:34.598303 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:34.599222 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:34.599649 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:34.616136 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Getting quotas for project acdf99bfe4454bd190356a3a79f0041f. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:24:34.619944 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.quota [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Getting quotas for user 00fb86d834c5405ea06e6c79ef712c25 and project acdf99bfe4454bd190356a3a79f0041f. Resources: {'instances', 'ram', 'cores'} {{(pid=108985) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:24:34.631064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Going to run 1 instances... {{(pid=108985) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:24:34.633285 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108985) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:24:34.807615 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-a872e66e-92c8-420b-9459-b14aebcf34d4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818209 Aug 27 04:24:34.808169 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 770/1567] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:24:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:24:34.819901 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-736df9eb-7acb-44c9-a2f5-bf73a8666a22 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:34.820507 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-736df9eb-7acb-44c9-a2f5-bf73a8666a22 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:34.925337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-736df9eb-7acb-44c9-a2f5-bf73a8666a22 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:34.933612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-736df9eb-7acb-44c9-a2f5-bf73a8666a22 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1218 microversion: 2.1 time: 0.119504 Aug 27 04:24:34.934170 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 798/1568] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:34 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1218 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:35.950206 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:35.950856 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:35.956779 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:35.957190 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:35.957966 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:35.958407 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:36.018191 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:36.025477 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-912c1b53-a5d7-4169-a462-acbae28ece7b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1222 microversion: 2.1 time: 0.078987 Aug 27 04:24:36.026027 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 771/1569] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:35 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:37.041991 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:37.042792 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:37.048666 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:37.049117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:37.049884 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:37.050524 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:37.113324 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:37.120678 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-aca32d32-7934-452e-92d5-a798451226f9 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1288 microversion: 2.1 time: 0.082419 Aug 27 04:24:37.121236 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 799/1570] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:37 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:38.141991 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:38.142633 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:38.149483 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:38.149940 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:38.150780 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:38.151224 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:38.303390 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:38.311084 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-428e5e99-79f5-4434-b35a-24570c0d2582 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.172663 Aug 27 04:24:38.311659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 772/1571] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:38 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:38.476689 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-78d1354c-6e39-475d-ba15-9dbe46cabab7 req-4c987698-8cb9-48c1-ad8a-9ea6e7e33f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9ed4808-df5e-49ea-94f9-3e707d48ac05", "tag": "a238e757-a409-433c-b725-1dcf138dba4e"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:38.478995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:38.478995 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:24:38.486105 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-78d1354c-6e39-475d-ba15-9dbe46cabab7 req-4c987698-8cb9-48c1-ad8a-9ea6e7e33f45 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:38.489058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-78d1354c-6e39-475d-ba15-9dbe46cabab7 req-4c987698-8cb9-48c1-ad8a-9ea6e7e33f45 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:38.497834 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-78d1354c-6e39-475d-ba15-9dbe46cabab7 req-4c987698-8cb9-48c1-ad8a-9ea6e7e33f45 service nova] Creating event network-changed:a238e757-a409-433c-b725-1dcf138dba4e for instance c9ed4808-df5e-49ea-94f9-3e707d48ac05 on hv-cinder-80475 Aug 27 04:24:38.502669 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-78d1354c-6e39-475d-ba15-9dbe46cabab7 req-4c987698-8cb9-48c1-ad8a-9ea6e7e33f45 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030004 Aug 27 04:24:38.503343 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 800/1572] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:24:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:39.328323 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:39.329670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:39.335841 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:39.336296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:39.337091 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:39.337529 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:39.459290 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:39.466790 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e58c7c19-5a4c-467b-b7bc-f7ecc8231494 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.142114 Aug 27 04:24:39.467357 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 773/1573] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:39 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:40.484438 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:40.485144 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:40.491482 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:40.491934 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:40.492710 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:40.493151 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:40.612640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:40.619766 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-38fc420d-b650-4a91-b515-e6f9bfd04568 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.139430 Aug 27 04:24:40.620320 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 801/1574] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:40 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:41.636751 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:41.637366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:41.643809 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:41.644266 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:41.646190 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:41.646671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:41.770673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:41.778359 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-401b704c-a908-44b1-b5b3-608d72a158df tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.145569 Aug 27 04:24:41.778953 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 774/1575] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:41 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:42.746414 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:24:42.747117 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:24:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:24:42.795370 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:42.795979 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:42.802438 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:42.802911 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:42.803671 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:42.804100 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:42.924124 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:42.934918 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-61f97b0d-8220-4355-9b82-b297aef4f0bc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.143332 Aug 27 04:24:42.935513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 802/1576] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:42 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:43.952287 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:43.952893 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:43.959424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:43.959864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:43.960628 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:43.961072 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:44.082714 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:44.090089 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-96c4505e-0cb3-45ea-a18d-9f340bd56549 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.141485 Aug 27 04:24:44.090701 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 775/1577] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:43 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:45.106944 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:45.107575 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:45.113612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:45.114055 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:45.114841 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:45.115271 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:45.241702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:45.248897 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-e4c0a585-bae3-4aa7-a62f-1afd5c5b4132 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.145607 Aug 27 04:24:45.249463 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 803/1578] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:45 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:24:46.267924 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:46.268548 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:46.273752 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-20a60697-dac1-4a65-b29e-07e7b70a083f req-b74cd366-f5a4-470e-9537-550eea608a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ed4808-df5e-49ea-94f9-3e707d48ac05", "name": "network-vif-plugged", "status": "completed", "tag": "a238e757-a409-433c-b725-1dcf138dba4e"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:24:46.274211 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:46.274491 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:46.275334 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:46.275451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:24:46.275451 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:24:46.275767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:46.282470 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-20a60697-dac1-4a65-b29e-07e7b70a083f req-b74cd366-f5a4-470e-9537-550eea608a4d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:46.282959 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-20a60697-dac1-4a65-b29e-07e7b70a083f req-b74cd366-f5a4-470e-9537-550eea608a4d service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:46.294593 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-20a60697-dac1-4a65-b29e-07e7b70a083f req-b74cd366-f5a4-470e-9537-550eea608a4d service nova] Creating event network-vif-plugged:a238e757-a409-433c-b725-1dcf138dba4e for instance c9ed4808-df5e-49ea-94f9-3e707d48ac05 on hv-cinder-80475 Aug 27 04:24:46.300151 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-20a60697-dac1-4a65-b29e-07e7b70a083f req-b74cd366-f5a4-470e-9537-550eea608a4d service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087840 Aug 27 04:24:46.300988 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 776/1579] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:24:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:24:46.403096 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:46.410251 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-acaaecac-2068-46d9-8ff2-2d726bd378c4 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.146180 Aug 27 04:24:46.410891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 804/1580] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:46 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:24:47.428525 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:47.429225 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:47.435671 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:47.436122 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:47.436923 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:47.437358 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:47.557154 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:47.564251 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-74454d2b-4da2-4d82-ab40-ed7f49268842 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1318 microversion: 2.1 time: 0.140300 Aug 27 04:24:47.564805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 777/1581] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:47 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:24:48.580768 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:24:48.581378 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:24:48.587878 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:48.588327 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:48.589101 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:24:48.589535 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:24:48.710282 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:24:48.717583 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9c4b22bb-8b0f-4900-9867-65a88550bd64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1507 microversion: 2.1 time: 0.140517 Aug 27 04:24:48.718140 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 805/1582] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:24:48 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1507 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:12.534044 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b5c603c-9e8c-409c-b092-3b97e11da80f", "device": "/dev/sdb"}} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:12.535622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:12.541385 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:12.541837 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:12.542629 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:12.543066 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:13.492771 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-6332d455-6c9a-4758-9aa2-b3a65290ddc2 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "POST /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963020 Aug 27 04:25:13.493394 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 778/1583] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:25:12 2021] POST /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05/os-volume_attachments => generated 194 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:41.209987 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:41.210497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:41.217127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:41.217662 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:41.218449 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:41.218922 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:41.307693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lazy-loading 'services' on Instance uuid c9ed4808-df5e-49ea-94f9-3e707d48ac05 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:25:41.682929 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-562dd670-887b-4d99-8a7b-1760d4c69e35 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05/os-volume_attachments/5b5c603c-9e8c-409c-b092-3b97e11da80f" status: 202 len: 0 microversion: 2.1 time: 0.476050 Aug 27 04:25:41.683454 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 806/1584] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:25:41 2021] DELETE /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05/os-volume_attachments/5b5c603c-9e8c-409c-b092-3b97e11da80f => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:25:42.804079 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:42.804670 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:42.812006 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:42.818372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:42.818372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:42.818372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:42.837978 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Going to try to terminate instance {{(pid=108985) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:25:43.132369 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-3cdfe236-c099-4b77-97f1-d4c5e48ec0cb tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "DELETE /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 204 len: 0 microversion: 2.1 time: 0.332340 Aug 27 04:25:43.132864 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 779/1585] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:25:42 2021] DELETE /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:25:43.142679 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:43.143500 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:43.149755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:43.150223 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:43.151029 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:43.152161 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:43.279452 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:43.287244 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5a21357b-e948-4de0-9c2e-5eac00d83c61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1513 microversion: 2.1 time: 0.148913 Aug 27 04:25:43.287807 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 807/1586] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:25:43 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:44.306215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:44.306957 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:44.313377 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:44.313824 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:44.314639 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:44.315068 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:44.435177 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:44.442259 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-e95e8a57-d7db-473d-a7ea-ddbfad3dcad5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1513 microversion: 2.1 time: 0.141110 Aug 27 04:25:44.442854 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 780/1587] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:25:44 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:45.459504 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:45.460133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:45.466571 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:45.467028 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:45.467793 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:45.468221 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:45.590493 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:45.597785 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5238c986-ab11-4c6a-8c88-1dc0784a5a91 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1513 microversion: 2.1 time: 0.142052 Aug 27 04:25:45.598363 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 808/1588] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:25:45 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1513 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:45.948228 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [req-86c0566e-cf2d-4cf7-a956-518dd644c417 req-e95258d3-30d4-454f-a0f8-abc47400a66c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9ed4808-df5e-49ea-94f9-3e707d48ac05", "name": "network-vif-deleted", "tag": "a238e757-a409-433c-b725-1dcf138dba4e"}]} {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:25:45.949815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:25:45.949815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: warnings.warn(msg) Aug 27 04:25:45.956479 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-86c0566e-cf2d-4cf7-a956-518dd644c417 req-e95258d3-30d4-454f-a0f8-abc47400a66c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:45.956922 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [req-86c0566e-cf2d-4cf7-a956-518dd644c417 req-e95258d3-30d4-454f-a0f8-abc47400a66c service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:45.967296 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.compute.server_external_events [req-86c0566e-cf2d-4cf7-a956-518dd644c417 req-e95258d3-30d4-454f-a0f8-abc47400a66c service nova] Creating event network-vif-deleted:a238e757-a409-433c-b725-1dcf138dba4e for instance c9ed4808-df5e-49ea-94f9-3e707d48ac05 on hv-cinder-80475 Aug 27 04:25:45.972229 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [req-86c0566e-cf2d-4cf7-a956-518dd644c417 req-e95258d3-30d4-454f-a0f8-abc47400a66c service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130295 Aug 27 04:25:45.972815 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 781/1589] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:25:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:25:46.615277 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:46.615888 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:46.621775 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:46.622225 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:46.623033 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:46.623471 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:46.659015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:46.659844 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:46.660429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.objects.instance [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lazy-loading 'fault' on Instance uuid c9ed4808-df5e-49ea-94f9-3e707d48ac05 {{(pid=108986) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:25:46.703879 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:25:46.712117 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7ed03d81-6eac-4b47-8443-e7f443bdcbef tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 200 len: 1308 microversion: 2.1 time: 0.100371 Aug 27 04:25:46.712941 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 809/1590] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:25:46 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:25:47.731215 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:25:47.731830 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: c9ed4808-df5e-49ea-94f9-3e707d48ac05] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:25:47.737887 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:47.738324 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:47.739116 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:25:47.739551 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:25:47.753704 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.wsgi [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] HTTP exception thrown: Instance c9ed4808-df5e-49ea-94f9-3e707d48ac05 could not be found. Aug 27 04:25:47.754286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Returning 404 to user: Instance c9ed4808-df5e-49ea-94f9-3e707d48ac05 could not be found. {{(pid=108985) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:25:47.755131 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-1832e9b9-5c76-4f8e-a801-5e0fad36b1f6 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05" status: 404 len: 111 microversion: 2.1 time: 0.028809 Aug 27 04:25:47.755647 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 782/1591] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:25:47 2021] GET /compute/v2.1/servers/c9ed4808-df5e-49ea-94f9-3e707d48ac05 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:26:00.145833 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1908881799", "imageRef": "40fbac20-d06c-4d7d-a56b-99e7f1168480", "flavorRef": "452", "networks": [{"uuid": "f9eb7a26-3cbe-4a98-a44c-9ba9695ebf5f"}]}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:00.195015 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.network.neutron [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] validate_networks() for [('f9eb7a26-3cbe-4a98-a44c-9ba9695ebf5f', None, None, None, None, None)] {{(pid=108986) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 27 04:26:00.594302 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Flavor limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 27 04:26:00.594762 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Image limits 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 27 04:26:00.595233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Flavor pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 27 04:26:00.595645 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Image pref 0:0:0 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 27 04:26:00.596050 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.virt.hardware [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108986) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 27 04:26:00.604382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:00.604822 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:00.605612 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:00.606661 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:00.622870 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Getting quotas for project acdf99bfe4454bd190356a3a79f0041f. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 27 04:26:00.626682 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.quota [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Getting quotas for user 00fb86d834c5405ea06e6c79ef712c25 and project acdf99bfe4454bd190356a3a79f0041f. Resources: {'instances', 'ram', 'cores'} {{(pid=108986) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 27 04:26:00.637098 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Going to run 1 instances... {{(pid=108986) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 27 04:26:00.639433 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='40fbac20-d06c-4d7d-a56b-99e7f1168480',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108986) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 27 04:26:00.759436 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [2bcf131e-3819-4d20-89fc-1fe661f241e6] AMQP server on 10.222.0.73:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 27 04:26:01.775495 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [2bcf131e-3819-4d20-89fc-1fe661f241e6] Reconnected to AMQP server on 10.222.0.73:5672 via [amqp] client with port 43094. Aug 27 04:26:01.779639 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-9548eea3-9053-49c5-a831-7749786530fc tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.637444 Aug 27 04:26:01.780288 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 810/1592] 10.222.0.73 () {60 vars in 1147 bytes} [Fri Aug 27 04:26:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 27 04:26:01.789950 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-7e1a7c19-24ce-45db-8b09-712222c4e7d5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:01.790573 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-7e1a7c19-24ce-45db-8b09-712222c4e7d5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:01.845255 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-7e1a7c19-24ce-45db-8b09-712222c4e7d5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:01.851603 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-7e1a7c19-24ce-45db-8b09-712222c4e7d5 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1219 microversion: 2.1 time: 0.065318 Aug 27 04:26:01.852190 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 783/1593] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:01 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:02.869086 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a3a79b49-65e6-4fae-91f7-05034f84cfb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:02.869702 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a3a79b49-65e6-4fae-91f7-05034f84cfb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:02.922455 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a3a79b49-65e6-4fae-91f7-05034f84cfb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:02.929094 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a3a79b49-65e6-4fae-91f7-05034f84cfb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1219 microversion: 2.1 time: 0.063655 Aug 27 04:26:02.929642 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 811/1594] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:02 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:03.948694 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-693d2b73-3b77-4c8c-b87b-02c2135b6cb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:03.949311 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-693d2b73-3b77-4c8c-b87b-02c2135b6cb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:03.999487 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-693d2b73-3b77-4c8c-b87b-02c2135b6cb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:04.006782 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-693d2b73-3b77-4c8c-b87b-02c2135b6cb3 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1219 microversion: 2.1 time: 0.061783 Aug 27 04:26:04.007327 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 784/1595] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:03 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:05.023727 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:05.024342 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:05.030849 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:05.031305 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:05.032133 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:05.032578 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:05.090099 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:05.097730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-10f97e26-a71b-436d-863b-d66dbebf0d61 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1215 microversion: 2.1 time: 0.077688 Aug 27 04:26:05.098295 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 812/1596] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:05 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:06.114984 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:06.115592 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:06.121329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:06.122460 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:06.123271 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:06.123712 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:06.182038 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:06.190142 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-72b6dc30-1216-46cf-8f0f-1498fbfbf2f7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1277 microversion: 2.1 time: 0.078727 Aug 27 04:26:06.190741 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 785/1597] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:06 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1277 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:07.175974 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-c4126f0b-96fa-439a-b554-778f9830d601 req-52f7260a-1149-4a4a-8929-390b0efcc287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b", "tag": "60cca948-fafd-4300-a030-a5cb4e843962"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:07.177837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:26:07.177837 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:26:07.186127 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-c4126f0b-96fa-439a-b554-778f9830d601 req-52f7260a-1149-4a4a-8929-390b0efcc287 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.186622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-c4126f0b-96fa-439a-b554-778f9830d601 req-52f7260a-1149-4a4a-8929-390b0efcc287 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.197056 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-c4126f0b-96fa-439a-b554-778f9830d601 req-52f7260a-1149-4a4a-8929-390b0efcc287 service nova] Creating event network-changed:60cca948-fafd-4300-a030-a5cb4e843962 for instance e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b on hv-cinder-80475 Aug 27 04:26:07.203020 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-c4126f0b-96fa-439a-b554-778f9830d601 req-52f7260a-1149-4a4a-8929-390b0efcc287 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030672 Aug 27 04:26:07.203706 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 813/1598] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:26:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:26:07.207145 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:07.207763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:07.213604 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.214077 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.214871 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:07.215368 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:07.339431 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:07.347097 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-b5a6674a-af94-4f6f-902e-31b453d2876c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.143549 Aug 27 04:26:07.347717 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 786/1599] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:07 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 27 04:26:08.364755 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:08.365497 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:08.373598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:08.373598 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:08.374121 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:08.374574 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:08.495075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:08.502382 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-7d46aed9-102b-4ead-a3f3-dc451dbb842d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.142655 Aug 27 04:26:08.502978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 814/1600] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:08 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:09.518800 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:09.519444 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:09.525286 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:09.525740 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:09.526506 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:09.526963 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:09.645201 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:09.652289 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-10c98fb5-3214-4aa8-a2a0-1925289b4816 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.137141 Aug 27 04:26:09.653457 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 787/1601] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:09 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:10.669260 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:10.669871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:10.675767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:10.676220 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:10.676986 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:10.677419 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:10.797764 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:10.805183 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d2b5a00b-73df-4fcf-9e36-c207e1c3bf0a tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.140071 Aug 27 04:26:10.805990 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 815/1602] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:10 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:11.822424 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:11.822995 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:11.829942 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:11.830389 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:11.831205 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:11.831639 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:11.952499 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:11.959675 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-656e1a2a-5a7d-4f98-9272-6bb45d9f5255 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.141009 Aug 27 04:26:11.960235 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 788/1603] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:11 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:12.978532 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:12.980268 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:12.985944 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:12.986397 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:12.987201 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:12.987640 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:13.105513 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:13.112817 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-a88a4d33-c092-450b-a38c-915381c3e515 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.139812 Aug 27 04:26:13.113380 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 816/1604] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:12 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:14.128990 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:14.129622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:14.135443 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:14.135892 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:14.136711 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:14.137707 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:14.257929 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:14.265848 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-d6b97d2d-9fcb-493c-96f1-59d7aecb2790 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.140528 Aug 27 04:26:14.266415 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 789/1605] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:14 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:14.709800 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-6a07bbda-9b4c-45e0-ad4b-dd4bbf2cc1c4 req-7fc62115-b411-40ac-966d-9525e2ecdce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b", "name": "network-vif-plugged", "status": "completed", "tag": "60cca948-fafd-4300-a030-a5cb4e843962"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:14.711355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:26:14.711355 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:26:14.718730 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-6a07bbda-9b4c-45e0-ad4b-dd4bbf2cc1c4 req-7fc62115-b411-40ac-966d-9525e2ecdce7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:14.719168 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-6a07bbda-9b4c-45e0-ad4b-dd4bbf2cc1c4 req-7fc62115-b411-40ac-966d-9525e2ecdce7 service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:14.729581 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-6a07bbda-9b4c-45e0-ad4b-dd4bbf2cc1c4 req-7fc62115-b411-40ac-966d-9525e2ecdce7 service nova] Creating event network-vif-plugged:60cca948-fafd-4300-a030-a5cb4e843962 for instance e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b on hv-cinder-80475 Aug 27 04:26:14.735304 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-6a07bbda-9b4c-45e0-ad4b-dd4bbf2cc1c4 req-7fc62115-b411-40ac-966d-9525e2ecdce7 service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029192 Aug 27 04:26:14.735871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 817/1606] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:26:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:26:15.282763 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:15.283380 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:15.289122 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:15.289575 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:15.290342 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:15.290805 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:15.418996 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:15.426792 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-aee6520c-72db-425b-9fea-cd5121543863 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.147661 Aug 27 04:26:15.427359 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 790/1607] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:15 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:16.444393 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:16.445156 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:16.451871 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:16.452317 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:16.453085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:16.453542 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:16.577323 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:16.584767 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-bb655ffe-5837-4518-b824-caeb285d46ff tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1319 microversion: 2.1 time: 0.144431 Aug 27 04:26:16.585341 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 818/1608] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:16 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:17.602540 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:17.603172 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:17.609060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:17.609515 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:17.610288 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:17.610761 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:17.735366 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:17.742673 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-f9e2b359-e9a7-4680-b97b-086d4b02224b tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1508 microversion: 2.1 time: 0.143862 Aug 27 04:26:17.743246 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 791/1609] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:17 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:17.758900 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c96d9c0-f9a0-4a6f-8cd2-62c1eefc6671", "device": "/dev/sdb"}} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:17.760441 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:17.767076 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:17.767527 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:17.768293 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:17.768725 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:18.497006 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-f62317a0-f177-488c-a1ae-10a30d553d66 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "POST /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741603 Aug 27 04:26:18.497622 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 819/1610] 10.222.0.73 () {60 vars in 1323 bytes} [Fri Aug 27 04:26:17 2021] POST /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:26:39.236064 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:26:39.236547 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:26:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:26:41.445762 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:41.446376 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:41.452699 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:41.453147 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:41.453913 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:41.454345 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:41.535268 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lazy-loading 'services' on Instance uuid e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:26:41.718962 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-0fb19e8b-6680-4d51-be0f-084c5e2efd53 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b/os-volume_attachments/1c96d9c0-f9a0-4a6f-8cd2-62c1eefc6671" status: 202 len: 0 microversion: 2.1 time: 0.277040 Aug 27 04:26:41.719456 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 792/1611] 10.222.0.73 () {58 vars in 1416 bytes} [Fri Aug 27 04:26:41 2021] DELETE /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b/os-volume_attachments/1c96d9c0-f9a0-4a6f-8cd2-62c1eefc6671 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 27 04:26:43.896693 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:43.897283 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:43.903978 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:43.904623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:43.905407 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:43.905847 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:43.931674 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Going to try to terminate instance {{(pid=108986) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 27 04:26:44.259644 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-d1718da0-2c84-4491-86ef-805f76ff1c6c tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "DELETE /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 204 len: 0 microversion: 2.1 time: 0.366928 Aug 27 04:26:44.260426 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 820/1612] 10.222.0.73 () {58 vars in 1239 bytes} [Fri Aug 27 04:26:43 2021] DELETE /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 27 04:26:44.279258 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:44.279976 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:44.285924 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:44.286379 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:44.287201 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:44.287637 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:44.409833 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:44.417749 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-896bf7f6-a4c4-4ac3-8e65-3a795e552006 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1514 microversion: 2.1 time: 0.143195 Aug 27 04:26:44.418329 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 793/1613] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:44 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:45.437190 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:45.438058 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:45.445164 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:45.445623 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:45.446400 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:45.446891 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:45.569716 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.policy [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108986) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:45.577927 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-b56f41de-b69c-4aeb-84aa-6251035c88c7 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1514 microversion: 2.1 time: 0.146264 Aug 27 04:26:45.578499 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 821/1614] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:45 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:46.595197 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:46.595811 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:46.601455 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:46.601895 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:46.602680 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:46.603111 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:46.726233 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:46.733616 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-9032152a-5926-4ea0-a4fc-809700630e64 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1514 microversion: 2.1 time: 0.142604 Aug 27 04:26:46.734194 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 794/1615] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:46 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:46.936917 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [req-a28f40a8-47d1-4f67-ba4d-caf3a797e672 req-bb8b8654-1e61-4cfd-9dc2-6fd158da8c1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b", "name": "network-vif-deleted", "tag": "60cca948-fafd-4300-a030-a5cb4e843962"}]} {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 27 04:26:46.939233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 27 04:26:46.939233 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: warnings.warn(msg) Aug 27 04:26:46.947240 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-a28f40a8-47d1-4f67-ba4d-caf3a797e672 req-bb8b8654-1e61-4cfd-9dc2-6fd158da8c1a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:46.947810 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [req-a28f40a8-47d1-4f67-ba4d-caf3a797e672 req-bb8b8654-1e61-4cfd-9dc2-6fd158da8c1a service nova] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:46.960160 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.compute.server_external_events [req-a28f40a8-47d1-4f67-ba4d-caf3a797e672 req-bb8b8654-1e61-4cfd-9dc2-6fd158da8c1a service nova] Creating event network-vif-deleted:60cca948-fafd-4300-a030-a5cb4e843962 for instance e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b on hv-cinder-80475 Aug 27 04:26:46.965082 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [req-a28f40a8-47d1-4f67-ba4d-caf3a797e672 req-bb8b8654-1e61-4cfd-9dc2-6fd158da8c1a service nova] 10.222.0.73 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Aug 27 04:26:46.965851 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 822/1616] 10.222.0.73 () {64 vars in 1318 bytes} [Fri Aug 27 04:26:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 27 04:26:47.750814 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.api.openstack.wsgi [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108985) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:47.751372 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.compute.api [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108985) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:47.757347 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:47.757791 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:47.758685 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:47.759053 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:47.789178 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:47.789622 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG oslo_concurrency.lockutils [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108985) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:47.790094 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.objects.instance [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lazy-loading 'fault' on Instance uuid e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b {{(pid=108985) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 27 04:26:47.829569 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: DEBUG nova.policy [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00fb86d834c5405ea06e6c79ef712c25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acdf99bfe4454bd190356a3a79f0041f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108985) authorize /opt/stack/nova/nova/policy.py:199}} Aug 27 04:26:47.836280 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO nova.api.openstack.requestlog [None req-fd305ad2-bc42-4f45-8c12-216d32b9f27d tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 200 len: 1309 microversion: 2.1 time: 0.089477 Aug 27 04:26:47.840273 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: [pid: 108985|app: 0|req: 795/1617] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:47 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 27 04:26:48.854326 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Calling method '>' {{(pid=108986) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 27 04:26:48.855068 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.compute.api [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] [instance: e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b] Fetching instance by UUID {{(pid=108986) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 27 04:26:48.862085 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:48.862540 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:48.863337 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 27 04:26:48.863772 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG oslo_concurrency.lockutils [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Lock "5b77e019-e5d4-4508-b689-805a75164f6e" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108986) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 27 04:26:48.877579 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.wsgi [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] HTTP exception thrown: Instance e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b could not be found. Aug 27 04:26:48.878163 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: DEBUG nova.api.openstack.wsgi [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] Returning 404 to user: Instance e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b could not be found. {{(pid=108986) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 27 04:26:48.879007 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO nova.api.openstack.requestlog [None req-5f092619-cee7-47c6-9cc8-f9d9ab9d1454 tempest-VolumesSnapshotTestJSON-1101285865 tempest-VolumesSnapshotTestJSON-1101285865-project] 10.222.0.73 "GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b" status: 404 len: 111 microversion: 2.1 time: 0.028826 Aug 27 04:26:48.879526 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: [pid: 108986|app: 0|req: 823/1618] 10.222.0.73 () {58 vars in 1236 bytes} [Fri Aug 27 04:26:48 2021] GET /compute/v2.1/servers/e48fd080-6a8b-4fd3-aa3e-7d9fc204fd4b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 27 04:28:02.764060 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:28:02.764659 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:28:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:28:28.094887 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:28:28.095429 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:28:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:29:59.254039 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:29:59.254643 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:29:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:31:06.218573 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:31:06.219203 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:31:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:31:22.780910 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:31:22.781513 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:31:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:31:48.113405 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:31:48.114019 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:31:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:31:58.143387 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:31:58.144075 dv-cinder-804757-2-iscsi devstack@n-api.service[108986]: Fri Aug 27 04:31:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 27 04:32:03.188543 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 27 04:32:03.189062 dv-cinder-804757-2-iscsi devstack@n-api.service[108985]: Fri Aug 27 04:32:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!